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ABSTRACT 



This two-report volume was prepared to describe 
approaches for evaluating individual Office of Telecommunications 
Policy (OTP) demonstration projects in the future and to aid 
demonstration project directors iri project planning and development. 
The first report focuses on/ the role of planning and evaluation 
activities, stressing HheiT importance in helping the program to 
promote telecommunications use in social service delivery more 
effectively. It also presents an overview of the types of information 
that are useful in various phases of project development and includes 
an outline for the annual evaluation reports required of grantees. 
The second report examines the economic and financial characteristics 
of telecommunications demonstrations, presents a method for analyzing 
project costs, and then applies the method to the three projects that 
had gene gated sufficient data for an analysis. These case analyses 
are presented as case studies in an appendix. (LMM) 
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EXECUTIVE SUMMARY 




. * - _ _ , -i , the third in a series of reports submitted 

tOythe Of fiie ^ Telecommunications Policy (OTP) of the " 
? eE ^Sf?^H;£ Health , Education and Welfare ^ (PHEW) in response 
to JPP 147-78-HEW-05. * The goals of the contract! awarded to 
Kalba Bowen Assopiates in September 1978, were fcc^ (1) review * 

SL™ w^f t 5 e f iF st ~y ear activities of OTP's Telecommiinicatio 
Program; (2) develop approaches for evaluating individual 
demonstration, projects in the future; (3) identify factors ■ 
that nave an xrifluence on the successful institutionalization,' 
and transfer of > innovative uses of telecommunications; and (4) 
provide information on which to base future, actions for- Program 
development and offer recommendations concerning future rules 
for the program. ; - 



This volume has been prepared in response to the second 
goal. It is intended primarily for use bv demonstration 
project directors as they plan and develop their projects. 
The, first report focuses on the role 6f planning and eval-, 
uation activities. The report points out 'the importance 
of using planning and evaluation activities in helping the 
Program to promote more effectively the use of telecommuni- 
cations in sociaC service delivery. It also* presents an 
.overview of the types of information that, are useful in 
various phases of project development. This is followed bv 
an outline for annual evaluation, reports grantees a*e-rjs£~ 
quired -to submit i \ - \ * : •■ : J/ I 

The second repott examines the^ economic and financial 
characteristics of telecommunication^ demonstration^..- It 
presents a method for analyzing project costs. .Thismekhod 
is then applied t6 those projects that had generated suffi- 
cient data to permit an analysis to be conducted. These 
cost analyses, are presented as case studies in an" appendix, 
.to this report. 



4 Other reports resulting from Kalba Bowen Associates' 
research include: , ^ 



Eyaluaf-ion of Telecommunications Demonstratio n 
' Projects and Recommendations to* the PHEW 
communications Demonstration Program , e> 

Summary Report #146-01 



Tele -; 
Executive 



_/ During the preparation of the final reports/, OTP was 
. -moved from PHEW to the Department of Education. While, 
. in some cases, the impacts Of this move arefdiscussed 
within the context of the reports, we haveljhosen for" 
the most part to refer to OTP/DHEW' sjLnce this was the 
location of the Telecommunications DemonstraVion Pro- 
gram at the time -of our research. 
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•* Evaluation of Telkcomnrunications Demonstration ^ 
Projects and Recommendations to the PHEW Tele- 
communications Demonstration Program , Summary 
Report #146-02 7 - 0 



Strategies for Institutionalizing Telecommunications 
Demonstrations: A Review of -Innovation Barriers 
• and Program Alternatives , Final Report *#146-04. 
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PLANNING 7 AND EVALUATING* TELECOMMUNICATIONS DEMONSTRATION ' 
' ■„ ; PROJECTS >■ 

' * ' ' • ' ■ • • ..." ' 

h^^-.O 'INTRODUCTION ' ;. .. 

Planning 9 and evaluating activities, as they relate to 
the Telecommunications Demonstration Program and its projects, 
can be used as techniques .for a dynamic process of ins tit u- 

.'. tional learning. This model is very different from the . 

• generally accepted, notions of planning. Unlike the more 

traditional, static approaches to planning in which^objec- '* 
tiyete-are firmly established and a sequence of events is put 
into motioh to accomplish them, objectives xn a dynamic 
' learning model are established with the expectation that 
they will be modified or changed. This perspective follows 
directly f rom an assumption that in some .problem solving 
situations a detailed and precise formulation of a problem . , 
or mission f canrjot^be accomplished at - the start of the effort; 

Three levels *of success can be identified from the 

' ■ .■ ■ ■ , * ■ 

Program's basic mandate "to promote" the use of telecom- 
munications for social service delivery.— 1/ Successful 
promotion can be accpihplished by: ^ 

• Projects completing all tasks on 
their demonstration agendas; 

• Projects becoming institutionalized 

and continuing to , operate after \ ' 

Program funding ceases; and ' 

• Project concepts being adopted by ' ; , * / • ' 
other organizations and in othter locations. 



JL/ The Act created the Telecommunications Demonstration pro- 
gram to "promote the development of non-broadcast tele- 

services for the trans- 
?nH 25ft .distribution! and delivery of health, education, 
and public or» social service information." • - •„ 
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Each of 'these levels is some form of success, but clearly 
each succeeding level goes further in promoting telecommuni 
cations uses. v ' 

.The Telecommunications Demonstration Program h&s^ 

developed beyond the start-up phase. - The task before it 

»■■-.'■".»■■ * * • 

* ,, 

is tb improve as quickly as possible at turning projects 
into successful Program outputs. The more explicit the 
Program is in' its intended actions, ^Uie .more explicitly '■ 
expected consequences of these actions. are identified; 
the more explicit the Program' is in monitoring knot mea- 
suringthe consequences of its actions, the faster the 
Program will learn, to bie successful. The learning pro- 
cess can best be internalized through the dynamic use of 
planning and evaluation activities. The information needs 
and reporting procedures required by these activities are 
described in detail below. - ■ 1 



♦ . \ ■ V 

2.0 INFORMATION NEJJDS FOR PROGRAM EVALUATION A * 

2*1 The Purpose of Telecommunications Demonstration Projects 

Telecommunications demonstration projects for the 
delivery, of social service or public information may be 
divided ihtp those that demonstrate: 

• an alternate means of service delivery for 
,aa existing information service) ' 



aggregation of demand to exp'and access to 
existing 'services ; and 

new services that are made possible through 
the use qi% telecommunications . 



Individual projects will not necessarily be included in 
only one category. \por example/ the project conducted by 
the Deaf Community Center demonstrates an alternative to 
the TTY for communication among the deaf, but it also 

involves new services such as the utility of asynchronous 

j ■■ 

*■ ■ .j - * 

communication and videotext services made possible througtt 

advances in computer technology. . ) ~^ 

Regardless of which substantive category (ies) a project 
fa^Lls under, telecommunications demonstrations serve three 



basic functions. They are conducted to: 

develop experience in the use of tele- 
communications for social service delivery; 

• serve as operational examples tt of service 
delivery concept^; and 

# generate data to be used in further 
development or transfer of the concept.. 

. * i, • . .' . . - ' 
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With respect to planning an<5 evaluation activities of the 
Program and its projects, the last of these functions should 
receive the most' attention. With respect to^the output of 
the Program^ all three functions .are of relatively .equal 
importance because each plays a significant role in ^promoting 
the use of telecommunications for social service delivery. 
* . 

2 .2 Information Needs by Phase of Project Development 

In considering the successful execution of a demon- 
stration program, there is a variety of information needed 
at different stages of project development. \This sedtion 
provides an overview of the basic types of da\ta that can 
be useful in each developmental stage:. As the discussion 
below' illustrates > information requirements can be extremely 
burdensome. This section is not intended to suggest that 

all the types *of data listed are required for All projects; 

* 

rather, that projects varying in size and substance may have 
different informatioh-^rr^eds. Nevertheless, th6 full range 
of ty£>es of useful data are presented for reference purposes. 

■ . V \ * / 

The conduct of a demonstration project njay be divided 
into seven developmental phases. These are:/ 
, 1) • Policy Forihulation and Planning / 

• • ' / 

2). Preliminary Project Design . - 



3) Selection and Funding 

4) Feasibility 

5) Pilot Testing/Demonstration 

6) Project Operation 

7) Marketing anjk Transfer 



While these phases- appear to Occur in sequential order, 
activities in some phases may be parallel or recurring. 
For example, as discussed above, policy formulation and 
planning is dynamic and modif icat:yons • in policies or 
planned objectives may change during the course of the 
project. Similarly, activities related to marketing and 
transfer of the demonstration concept may begin in very 
early stages of the project as other organizations or 
individuals are alerted to the project and in some instances 
are actively courted to encourage their involvement. Not 
all phases are the responsibility of OTP; some are mainly 
conducted by the grantee and others are a joint effort o'f 
theJProgram staff and the grantee. 

The following paragraphs briefly list and describe the 
information needs for each of the above seven project phases 

•i 

(1) Policy Formulation and Planning Phase : puring 
this initial- phase, policy is established as to the overall 

•* ) 

. ■■■■ . ' ' H 



goals and the funding and staffing requirements for the 
project. ? It is also at this time that decisions are made - 
as to the intended scope and focus of the demonstration. 
This entails efforts at understanding the. program's pur- 
pose and selecting and plarining a course of action, t Since 
■ -i . * 

a number of groups should, be involved, • these. planning 
• activities would b!e a ma j or" undertaking. * Moreover , user 
groups who have a potential interest in the serviqes should 
be involved both in determining what services and technol- 
ogies are desired and in planning for the design and ~V 
selection of the demonstration. These planning activities 
are especially important where a prpject is perceived to 
•/be a relatively high risk. 

v « 

Information relevant to these activities should be 

\.\ t . . ^ - • . - 

^ction-oriented and should address the specific questions 
of all the involved parties/ The following are information 
products that could be developed or made available during 

thi^s phase: . - * . 

* . . 

clarification of short-term priorities* 
and long-term -goals; 

criteria for project selection *and funding; 

data and information on related projects 
(in public and private sectoral} .; / 

identification of potential benefits, 
savings, efficiencies to be achi^yedr 
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• identification of target groups: - end } • % 
users , servi'oe providers; 

• preliminary needs assessment v of ' * 

I "• v . ; ' : : ■•r^.iriien^ied^ * : 'vv 

• schedules, strategies > and mechanisms r - ' 
*y. > ; ' : f adopt ion and risk sharing; ; \ 

4 • esti^tes ; pf d^ for services and 
willingness to pay for and supp Jfrt ' ' 
• • v ' services on a loral basis ; • : . ' C-?^-' ':■ . f • ;' : : y'; ; ; . 

• • es t ixp|it es of pex^ce r cost3^z start-up k^^C- V- ■ 
% Voper^ v \ 

for economies bf^^ : >. - ■ 

• identif icatibri of roles of partici ^ * 9 
pating and contributing agencies and offices , ^ 

|: f ^; w 

• staffing requirements to 'administer * * 

- monitor , and assist the project; , ■ ""' 

• preliminary* identification of poten- 

V tial subcontractors;/ '' : :'^?\ Vv''-V*:- 

; identification of services to be 

provided including estimates of cost 0 V 

% -W:; V. times ; . • : ./• 

• identification of regulatory, legal, 
and political barriers'; 

• identif icatibri of institjutional v ^ 

barriers; ; ,,_.^ > 

• identif icatiqn bf : ^pp^po'^t^i;^iiiBS for > ' 
aggregating services ; '• • y * ' • . v ^ 

• identif ic&tiqn of technology specif i-r 

. cations', coitis, capabilities, and avaiT- 
; ability. 

(2) Preliminary Project Design Phaser Once the policy 
and planning activities hive been completed , an effort should 
be;]hade to design or outline in a preliminary fashion the 



3 



, components/ goals/ and characteristics of the proposed demon- 
stration. This effort entails going several steps 

beyond the planning activities of the first phase into a 

|: • • '. / • . ... ' ' • . . / . 

consideration of the details and problems of the proposed 

/project. Th& purpose of this exercise is to anticipate 

/problems before they arise arid involve participant groups, 

[including potential users, in the design process. 



In* the Program * s current mode of operation* this activity 
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is conducted by grantees after a Solicitation has been issued 
because grantees directly control the nature of the demonstration' 
project. W$re the Program to; take greater control over the formu- 
lation of demonstration concepts , then dt would also be more/ 
actively involyed in the preliminary design. ' During this/ 
phase an effort would be made to identify potential grantees" 
to determine if they would have an interest in submitting 
proposals and if t^iey have the resources and expertise to 
undertake successfully a demonstration project. On/the basis 
of the design work and these preliminary assessments of poten- 
tial grantees 1 - capabilities, a funding strategy /would be imple- 
mented and an RFP drafted. Currently, basic c/r iter ia for 
^demonstrations covering all technologies and/ all services are 
issued with the solicitation, and innovation in substance and 
method is left to those who choose to respond. . 

-The information produced in this phase should be directed 
towards resolving those issues and problems associated with 

' ' - .. , . . ~ . . s ■ M . .. 

,• . . : . . . 14 ■ • : • ;■: 



'-or 



the design of the demonstration projects and the identification 
and funding of potential grantees. Below are listed some of 
the • information products and activities tha^t would be produced 
during this phase: 

• verification of availability , appro- \ 
pr lateness, and reliability of • 
proposed technologies ^xi^k^'---' .- : ?v'- ' ?v 

^ m* preliminary design of proposed 
demonstration project 

> • " v .. . : ' : , ' . : - ' ;. •. '• - .; • ' ' \ \ 

m anticipated problems /barriers' 
• • funding strategy 41 

• potential grantees identified 
and assessment of capabilities 

• RFP. .. . . ' , _ v 

< 3 ) Selection and Funding Phase : During this phase the 
funding strategy is implemented, the RFP sent out, and a 
review committee designated to evaluate and select grantees. On 
the basis of the work completed in the previous phase, 
criteria reflecting established guidelines should be applied 
to the selection of projects to ensure that only projects 
which exhibit a high probability of achieving their first 
year goals are chosen. Groups with specific interests or 
expertise in different aspects of the proposed project should 
be involved in developing the selection criteria. 
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Naturally^yfirst year grantees should be subject to a 
different set of selection criteria than those applying for 
renewal or continuation grants. Although during the first year 
it may be a useful strategy to fund several projects on 



a one-year trial basis , th^re should also be a commitment - to 
fund those projects that evidence sucdess for the f ullj 1 
duratidn of their ^life cycle. 

The information products' of this phase are relatively 
minimal: . * 



selection criteria 

m criteria for first year 
■I. continuation funding v 

\ • list of funded projects. , ; 

(4) Feasibility Phase : For most projects, this pha|e 
.typically lasts from six months to two years during whicri 
time eithet the feasibility of the concept is demonstrated 
or it is not. During this period the project produces 
data on the cost effectiveness of the technology and services, 
' the needs of intended beneficiaries,, financial and funding 
plans, projected expansion costs, management plans, estimates 
of total development costs, and plans for encouraging wide- 
spread adoption. 

In order to carry out this phase, the projeqt should imple 
ment its services and systems on a trial basis to test the 
viability of the proposed system and to gauge users 1 and 
institutional receptivity. This is one of the/ most 
important phases of the project cycle; based upon the 
information gathered" during. this phase, a decision is 
made whether or not to commit funds to the complete 
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development of the demonstration cgncept. Therefore , the 
funding organization should provide clear and succincK/ / 
guidelines as to- what is expected of the grantees at th£ 
conclusion of this phase. Even with this assistance , however,, , 

t ,. f * I, " ' ' V 

independent assessments, of the, projects' should be made. 
These assessments,: should not simply be ■ evaluations , but in- 
depth analyses of the feasibility of the projects, both in 
t^rms of the concepts being tested and in. terms of the project's 
ability to achieve its long term goals. Typi cally , the costs 
of Vhe feasibility phase run about 10% of . th6 total development 
costs. ' Although its costs can be high/ it can be justified in 
terms of potential savings and improved performance. 

'Since this phase entails considerable analytic and research 
work', there is a potential conflict between the grantee 1 s need 
to initiate the project and deliver services and the sponsor's 
need to assess the feasibility of the project. Consequently, 
technical assistance may be required £rom the beginning. Whether 
or not this is the case, the grantees should be made aware of 
the "paper" requirements of this phase, and they should have the 
capabilities to provide the necessary iriformati on and data to 
complete. the feasibility phase. * 4 - . 



The following are the 'rather extensive information -and 
data Requirements of this phase. Most of these requirements 
are a part of the feasibility study: 



Fe\s ibi 1 i ty S tudy 
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cost-ef f ectiveness # of technology*' 
(comparative analysis if appropriate) 

, ■ •"' cost-effectiveness of services ^(software) 

(comparison with other modes i£ appropriate) 

• projected development costs and plan 

• financing plan 

r K ^tnanagement plan v 

^ needs assessment (and/or data on demancf 
for services) of end users # V 

• adoption/promotion strategies 

• plans and agreements fo 
institutional support and 

^cooperation ^ 

7 • plans for overcoming legal, 

regulatory, and political barriers 

• technical assistance information on 
conducting feasibility studies. 

I 5 ') Pilot Testing Phase : Once a demonstration project 
has passed the feasibility phase; i£ is then in a position 
to develop its capabilities and -resburces and pilot test its 
technologies and services. The purpose of this phase is tto 
further test out the technologies and services to eliminate 
any unforeseen, problems or obstacles. One can think of this 
phase as a trial exercise whereby the system is subjected 
to a real world test but under protected conditions. 

J. . " 12 . IS * 



Duifing this phase, the information requirements are not as 
extensive as in the feasibility phase because the project 
has demonstrated its worth and viability by , this time* 
However, the same criteria that were used* in the .feasibility 
phase should also <be reconsidered during the testing phase to 

I 4 : • .-. ;•' * . ' .... .- . 

correct any mistakes in. the feasibility study and to focus on v 
. those, problems that may come up in the future such as financial 
support , incred^e^^cale of operations, institutional coopera- 
tidn, and adoptioV and transferability. Particular attention 
should be paid to those problems that may ' prevent tile ti 
nology and service from becoming fully operational in the rtext 
phase . . 

■ v - • ■ ; r : 

(6) Operational Phalsb ; , When a project has reached this 
phase, it has eliminated most of its major problems and is 
delivering services to all of its intended clients at the cost 
and efficiency levels projected in the proposal. It has 
become self-supporting and does not require funding support 
for staff or equipment. Itvill, however , need funding 
to gather data and information used to evaluate its success 
and facilitate the transfer. of the technology and service 

■" ■ ■ ' : • . / ' ' ..." 

to other users. It may also need some additional funds to ■ 
improve and expand upon its operations, but these funds 
should not be used for changes in fundamental design or ' 

. • - v ' ■ w 

content. "* - 



The information produced during the operational phase 
lhas several purposes : firsts it is to^be used to determine 
whether or not the project should be promoted and transferred 
to other user groups and how promotion and "transfer should be, 
done. It is also used to evaluate the ^success of the project 
in achieving its intended objectives and provides ,inf optiation 
and data to sponsors^ as well as us^r groups to assess the 
reliability f of 'the original estimate in the feasibility 
studies ' and to better select new projects ' for funding. The 
data produced at the conclusion of this phase are similar to , 
those produced in an evaluation except that the data can be 
compared^ to- initial estimates and are collected to 'address 
specific policy questions raised in the first phase. 

In addition, to assessing the performance of the project 
in reaching its- operational phase, the data gathered at the 
conclusion of this phase should fpcus on those factors that 
affect its expansion and/or adoption by others. Although 
estimates were made in previous phases of the costs to expand 
or transfer the service and technology, and although the project 
may be intended ag a model for others to follow, it is only at 
the conclusion of this phase that sufficiently detailed 0 and 
reliable data are available to determine how easily the project 
can be imitated by others. Therefore, careful attention should 
be given to those often unique factors that either contributed 
to a the success or failure of the project to determine how 



situational success or failure was- If the ingredients 
of success were highly idiosyncratic to the" circumstances and 
personalities of the project, and these in turn are not easily 
replicable, then despite a project's success, it may be wise 
not to try to encourage its adoption and utilization, if the 
decision is made to prdmote transfer, it' may be essential to 
look for those conditions and -ingredients in other settings that 
are similar to those of the successful project, in makino this 
assessment, it is also important to determine if the demand for 
the services and technologi.es, as well as the incentives for 
adopting t^he technology and services, are as high as those in th 
successful demonstration. If this is the case, then a 
decision should be made to promote the adoption of the tech- 
nology and service , otherwise , the, better decision may .»*' 
be to terminate funding. 

Below are listed some of the principal types of. infor- 
mation products of. this phase. A distinction is made between 
those information products used to assess the overall success 
Of the project, -and those used to decide whether the funds 
should be committed to encourage the "adoption and dissemination 
of .the project. . ' ✓ 

Project? Evaluation Information 

• start-up , pilot , and operation costs 

• cost-effectiveness of service delivery 

• econotnies of scale (if appropriate) \ 



m unit service delivery oo8ts 

e ratio of operating costs to fixed costs 

• cost sensitivities 

^ ^ effectiveness of funding procedures ^ 

e effectiveness of service in meeting needs • ■' "V « 

e performance of management and staff * 4 

m assessment institutional cooperation \ 

i . i * » - • 

• assessment of commitment of continuing' 
support and success 

Prospects for Dissemination and Adoption 

) 

• assessment of key situational factors 
contributing to success • 

e estimates of demand for service, ' 
* , benefits in other s6ttings ' 

• estimates of replication of success- 
ful factors in other settings 

\ ■ > " ': • ' • 

• identification of targets of opportunity 

• estimates of costs for promoting adoption 

• incentives for adoption in other settings 

• identif ication of -residual barriers * * 
to dissemination and adoption 

• estimates of (costs and risks for 

seryibe aggregation ^ 

(7) Marketing kpd Transfer Phase : If the decision is made 
to commit funds to the\/idespread promo ticm and adoption of the 



demonstration project, this phase of the project could 
consume major resources of the sponsoring agency. 

" . > ■ ' . 22 
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Furthermore,; the promotion, marketing, an4 transfer, of the 

1 - . *'■ \ 

project to other settings require , different skilis and* resources 

1 ' " ■ . \ 

( than the deyelopment and evaluation of the demonstration. Con- ' 

sequently, the sponsoring agency .will need to acquire thes,e x 

skills and resources at the onset of the marketing' and transfer phase 

» v "" l \ *K r 

As the experience of federal agencies in the" public 

sector — f and the experience of private firms — / have demon- 
strated, unless there is an effort to adopt the technology V 
to the needs and circumstances of potential users, no amount\ 
. of "push" can make up for a lack of "pull." Therefore, prior 
to any promotion or transfer activities, market studies 
should "be undertaken to identify potential adopters and their 
specific needs, resources, and incentives for adoption. The 
results of these -studies will help identify those users that 

i # i ' 

, may become earlier adopters as well as help identify • 
those changes or modifications in the "tAnsfer "package" that 
would increase the prospects^ for adoption. 



1 ■ \ 



With the. completion of the market studies and the iden- 
tification of target users, efforts should be made to* 



2/ 

— / Baer, W. , Johnson, L., Merrow, E., Analysis of Federally - 
Funded Demonstration Projects: ' Final Report , Rand 
Corporation, R-1926-DOC, April,. 1976. 

3 / Utterback, J., "Innovation in- Industry and the Diffusion 
i* of Technology," Science , V. 183, Feb. 15, 1974, pp. 6*20-626. 
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identify tha aj^propriate madia and activitiaa to raaoh proa** 
' pective adoptera. However,, depending upon how major and active 
a role the aponaoring agenoy wiahei to take in promoting trana- 
fer, risk sharing and technical assistance may be required. In 
those c^se* where the technology is relatively new, expensive, 
and not widely available, efforts* should be made to stimulate 
private sector development and marketing. 

In promoting the transfer and adoption of new telecommuni- 
cations technologies and services particular attention Should 
be given to the interests and needs of those decision-makers 
responsible for funding and administering the technology and 
service. Unfortunately, the clear demonstration of benefit to 
the end user or client is not always sufficient incentive for 
adoption by the administrator or provider. New technologies 
of ten; entail budgetary and organizational changes, undermine 
positions of authority, and jeopar^^^f organizational boundaries 
Consequently, there should be "something in it for " everybody" ; 
— administrators, funders, and service providers have to see 
that xt is in their best interest to adopt this innovation. For 

this reason the best adoption or transfer strategy is~©ne which 
"piggybacks" upon established habits and which has clear and 

demonstrable benefits to all concerned. Once the initial con- 
cept is accepted, improvements and embellishments can be 
added gradually on a modular or trial and error bysis. For 
example, unsophisticated users of telecommunications services 

l j a 
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are highly unlikely to be receptive to telefax, video conferen- 
cing, And packet switching. Rather, experience has to be gained 
with simple technologies and more obvious uses before techni- ' 
oally and behaviorally sophisticated applications oan be • 
assimilated.' Therefore, the transfer of an innovation should 
proceed in a stop-wise fashion before leading into more .sop^his-' 
ticatad and intensive applications. Very of, ten the best 
innovator is the user, who knows his/her needs and is ' able to 
adapt the technology and service to his/her- own circumstances 
and resources. The transfer strategy, as well as the technology, 
should be sufficiently flexible to allow for modifications and . 
mid-term alterations. 

There are two types of information produced during the 
marketing and transfer phase. The first is operational informa- 
tion, used to plan and complete the marketing and transfer; the 
second is evaluation information used to assess the success of 
the marketing and transfer activities. .• - ~ 



Operational Information 

f design of the "transfer package" 

• market studies of potential uses 

• f strategies for "fitting" technology 

and services to potential users 

• strategies for reaching potential 
users 

• incentives and risk sharing schemes ^ 
to encourage transfer 
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' • Identification of market segments and 
atratagiai for^jraaohing each segment 

a budgets for marketing, promotion, and 
tranefer aotivitiea 

* * 

e Diane for encouraging private sector 
involvement/turnkey arrangements 

Evaluation Information 



e cost-effectiveness of marketing efforts 
(by method and for each target group) 

e identification of eucc*s% factors 

e identification of bar 
service and technol 




e identification of bar 
marketing and promdtibrT' 

" ".■ 'a critique and recommendations . 

■ ... i 

(.4 

3.0 PROJECT REPORTING AND EVALUATION PROCEDURES 



The legislation creating the Telecommunications Demon- 
stration Program requires that the grantees themselves, be 
responsible for conducting project evaluations. The purpose 
of this section is to help projects standardize and simplify 
their evaluation efforts. The particular objectives of 
demonstration projects may vary from project to project. 
For example, one project may focus primarily on determining 
the cost^effectiveness of one technology over another, while 
another may focus primarily on organiz ing several 
agencies pr institutions to share 411 expensive telecommuni- 
cations facility. Thus, not all items suggested below may 

_2G 
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be applicable; however, an effort should be made by grantees 
to be as comprehensive -and detailed as .possible. - 

The purpose of the evaluation report is ' to ^ 
t:he experience gained^; oyer -the pro life and to determine 

the degreie to which ?t 
promoting the use~'of ^ 

social services . As ^discussed earlier , -ideally, there are 
three levels or ti^rs of success that a p jcq j ect can attaih^ . ; 

• completing all intended project tasks ; 

• demdhstratin.g^ that the project cone is 
meet in g a local ne ed by, con tihuin g oper a t i on ; :, : 
after Program fundirtg 

' . ' \-. • : ,: . •. ' : : ','/;■. . ; < ' ; / ■"; • ■' .■ 

• transferring the pro j6dt conceipt to , , > i 
other locations. ^ - "; 

Each successive level has a greater impact on meeting the Program 1 
goal of promoting telecommunications in service delivery . Of 
course , the first and second levels may not apply to projects 
that have completed only their fiifst or second year of 'Program 
funding, so £hat th& ma j ori ty of the information contained in the 
grantee's evaluation will relate to the successful conpletion of 
project tasks. It should be made -clear, however, that a us'eful 
evaluation is dependent to a great degree on a well designed 
demonstration. If a project is to produce the needed evaluative 
data, it must be designed from they beginning ft to generate that 
data. Thu^^fehe items discussed below are^ in essence design > 
elements for demonstration projects. 



Pro j ec t Evaluat ion 



. The project evaluation report ^hould be divided in six- 
sections as follows: . .: 

• Statement of th& Problem 
/•• Project Status T 



■ Cost Analysis ; '.. : ■ 

• Barriers to Implementation and 

Utilization - 

• Assessment pf Benefits 

• Str^fcfegies for Institutionalization 

A brief^ description of the topics to be covered arid questions 
to be answered in each of the sections?', of the project evaluation 
report is presented below. \ < * 

Definition of the Problem ; Demonstration projects can 
be thought of as a technique for problem solving. * Every 
id^a for a demonstration project results from the perception 
that there is a problem with the existing social service 
delivery system. The purpose of this section is to articulate 1 
^elearly the boundaries of: that problem and to outline how ^ 
a successful demonstration will solve the problem. 

The definition of the problem is one of the most crucial 
aspects of conducting a project evaluation because it 

establishes the basic hypotheses and premises that the 

.... , v ■ ■.»-.'. /" • 

demonstration is to prove.* It should also be noted that 6 * 
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there may be alternative formulations of what. appears to be 
the same problem. The following hypothetical examples 
of problem statements constructed for a demonstration 
project illustrate this difficulty and its implications: 

Statement I t There is an increasing need f or ^ 

particular eid^ation needs ca^ 
individuals interested in a particular subject 
are geographic^ ly - dispersed and cannot [be • ; 
gathered at one^ location ; ; Constructing a 
/network of local cable television systems 
would enable educational progranuning to reach 
a greater geographic area r ^ permitting 
the aggregation of this dispersed demand . 

Statement 2 ; Educational programming has 
been" developed for a wide variety of sub j 6c ts > 
but it has not been widely used because only 
a limited (local) means for distributing 
t^^programming is currently available A 
nfct»ork of local dab le television systems 
could be Used .to increase the distribution 
of dducatiorial programming. 



- Each of these hypothetical problem statements, which are ' 
quite different -from each other, has the- development of. a network 
o°f local cable television systems as its solution. The first 
statement has four components; 



There is a demand for continuing education; 

The problem is that demand is dispersed 
and no individual can by himself support 
the programming ; 

The solution is to aggregate demand; 

A network of cable systems is the 
tool for aggregating demand. 



1) 
2 ) 

3) 
4) 



In contrast' , the second statement implicitly assumes that 
there is an audience- interested in; viewing the available 

programming^ Its components are: 

• • ■ ' . **- .*•.- ''' ' ■' ■ • ■ ' ■ ' ■ ■ \ 

• , A* variety of educational programming 

exists; ' » - ' 

The problem is that there is not a 
s ( sufficient means of distribution; . ~' . 

• A cable network would provide the 
necessary distribution system. 

In the first statement, the problem actual ly has nothing 

to do with technology. There is a perceived structural 

problem with demand for services. The demonstration 

Would focus on a means of alleviating or resolving that 

■ - • . . -f -. ■ • 

structural problem which would require assembling a ca^le 

network. The second demonstration, in contrast, 'would focus 

primarily on the construction of the network. An observer 

viewing these two demonstrations would see basically the 

same activities: the development of a network and efforts 

to sign up viewers for the broadcasts. But the demonstrations 

would be attempting to examine two completely different 

problems . ^ 

The importance of properly and cleatly formulating the 
"demonstration problem 1 ; is that it is the projects 1 organizing 
principle. A prbperly formulated problem statement should 
spell out the expected benefits of using telecommunicaLtions 

« • ■ < 
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for the cdncept being demonstrated. The definition of the 
problem infliiencse^ the t^ 

activities of the project staff/ and the typps of external 
audiences that may be , interested in the project. Equally 
important, it is extremely valuable in avoiding a pitfall 
that of ten besets technology demonstrations: taking a 
technological^ solution arid finding a problem in which to 
use it. 

Project Status : The pxirpose of this section is to 
describe as specifically as possible how far along a project 
is in completing its derionstratiori agenda. Pour project 
phases have been distinguished and are described below. /! 
Although 'no particulate time periods for each phase can be 
specified, thes e phases are not arbitrary . They correspond 
to developmental periods in which project costs may differ . 
The project cost- analysis is based on data that is disaggregated 
by project phase. This portion of the project: evaluation 
report should describe project activities according to ( 
the following phases. '. 0 

■' • . * 

(1) Start-up Phase : This is the initial phase of project 

development during which equiment is procured, staff is hired 



and briefed, service agreements are finalized, and needs assessment 

*■■ .•• 

are performed. This phase is completed when all these tasks 

•*'■" ■ " ■ . • ■ ■ 

have been performed* If for some reason a project is not able 

■' p . • ■ 

to complete one of these tasks and has proceeded to the following 

phase, a* brief explanation should be given— In some cases, some 

of these tasks may carry over into the next phase , but since such 

a carry-over can affect project performance, it should be noted, 

(2) Trial Operations Phase : The purpose of this phase 

is to train staff in the use of equipment -and in the methods of . 
service delivery. In most cases, a small group of end users is 
selected to work closely with project staff to iron out problems . 
Typically, this i^ a period of great : f lux during which changes 
have to be made in staff, services, and, in some cases, equip- 
ment* While services are delivered during this pfyase, the primary 
intent is to discover problems and work them out so that service 
delivery can proceed more smoothly in the next phase. As in 
the case of the previous phase, this phase is only completed when 
all principal tasks have been completed. This generally occurs 
when all major problems have been worked out and stable operating 
and service delivery procedures have b$en implemented and understooc 
by all principal participants. If this has not occurred, these 
problems should be noted and brief explanations provided. 

(3) Demonstration Phase : For many projects this would 
constitute the final phase of their development under DHEW 



supRprt. ; It is during this phase .that all intended (revised) , 
services are delivered . Since by this time all major mana- : 
gerial> prgani2atidnal # service delivery ■:; and institutional 
problems should have been either overcome or accommodated , 
It represents a fair demonstration of what telecommunications-- 
based services can achieye • The successful completion of this 
phase comes not only with the delivery of all intended services 
but also with the evaluation of the success and problems of the 
project . Since the objective of demonstration projects is 
not jusV the delivery of services , but the assessment of the 
bene fits/disbene fits and cost savings of the project to 
encourage adoption by others , it is critical that the evalua- 
tions are complete and- answer the concerns of potential 
adopters and flinders, ^ 

(4) Institutionalization Phase i When a project has 
reached this phase it has sufficiently demonstrated its 
value to become self -supporting and adopted by local . or 
other service organizations. It is no longer dependent upon 
federal funds for its survival , receiving ongoing support from 
state and local agencies. By this time it is also servicing 
a stable population of end users who have benefitted and can , 
expect to continue to benefit from the services. A/ demand 
for the project's services has been established and a means for 
meeting both that demand and financing the services has been 
achieved • * • 



Cost and Financial Analysis : A ma jor ^fgijSient fir 
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employing telecommunications in the delivery of social 
services is that its use is cost-effective. -4/ At an 
identifiable volume of service delivery, it 'is often less 
expensive to use telecommunications to deliver services than 
to employ another method pemonstrations must explore the 
economic characteristics of service delivery) The primary ^ 
purposes of conducting a cost and financial analysis are to: 



• Identify the structure of costs by type ~ ~ — — 

a of resource used over the four project 

phases; 

• Analyze cost sensitivities including 
the substitutability between labor 
and technology, the substitutability 
of alternative technologies , and the, 
effetft on cost of increasing the volume 
of services delivered over the demon- 
stration system;^ 

• •■ i 

• Compare the cost of delivering services ; 
using the demonstration system to the 
costs of service delivery^ using other 
existing or possible delivery modes. 

The identification over time of the structure of costs s^ch 

as labor , equipment and space provides important financial 

information to others who may want to adopt or adapt the system 

for their own use. Analyzing cost sensitivities provides 

valuable data on the potential for economies of scale and 

may permit a determination of the optimum size of an oper- 

•\ * * ■ . 

ational system since demonstrations often serve a relatively 

small number of users. The comparison of costs for service 



A/ Lttt*^ di f u f? ion of the methods and inforamtion require 
- ments for conducting a cost analysis of a teleconununications 
.^f^iSJer j6Ct is ^-nt,d in the f oll^i^ 3 
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delivery by tjhe demonstration system versus other delivery 
methods is an analysis of cpst-ef fectiveiiess. It can onl,y 
be conducted when data on alternative" delivery methods are 
available; such comparisons are the true test of economiq 
viability of the demonstration concept . Because demonstration 

projects are often unique, such comparable data may not/ 

• . \ ' . \ ■ ." . i ' . . ; 

however, be available. 



Barriers 



to Implementation and Utilization : While 



economics may be a good reason for wanting to employ tele- 
communications, there are often a series of barriers to 
implementing the demonstration system and using it for 
delivering the intended information services. -Several 
demonstration projects already funded serve as examples. 
PACE Institute faced major delays in obtaining and installing 
equipment and as a result progress was greatly impeded. 
Other projects 'faced organizational barriers. For example, 
the Pennsylvania State University cable, network project relied 
on the 1 state cable industry to take the initiative to 
assemble the network.*- , Much of the control over the future 
of the project was not in the hands of the grantee, and 
major delays resulted. Still others have run into legal } 



or regulatory impedimenta. The continuing medico^, education 
project by the Medical Care Development Center required that 
the FCC issue a special license/ which jri the end the , 
Commission did not grant. The efforts by the Center for 
Excellence to establish a special radio station for the 
blind, deaf and homebound were very successful, but copy- 
right laws restrict the\ use of their programming materials 
to particular target populations. The special receivers * 
required to receive the Centex broadcasts cannot be commer- 
cially sold which suggests the prospect of permanent 
subsidies to support the system. Thus, legal barriers 
greatly inhibit audience expansion beyond the deipons trat ion 
participants. 

In this portion of an evaluation report the barriets 
to implementation and utilization should be carefully docu- 
mented. The experiences encountered by individual projects 
will be extremely useful to the Demonstration Program staff. 
It will assist them in identifying projects in the future 

that might encounter similar problems. It Will also be 

* 

useful to other organizations attempting to replicate the 
demonstration system. 

In completing this section of the report, care should 
be taken to identify the barriers encountered,- and successful 
as well as unsuccessful attempts to overcome the barriers 
and the reasons theise efforts failed or succeeded. f \ 

' P {: • 36 . • •' - , 
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Barriers to implementation anoj utilization may be 
classified into three categories^ / 

i* * 

4 

e Technical 

e Organizational/Institutional 
• Regulatory and Legal 

Technical barriers may include obstacles such as. 
difficulties in obtaining equipment, in developing or 
using necessary software, in establishing and implementing 
an effective training program, as well as resistance by 
system users to using a new technology or service. 

Organizational/institutional barriers often involve 
difficulties in obtaining the support or at least the acqui- 
escence of other agencies or. service organizations. Just as 
an innovation can be resisted by new users, it can also meet 
considerable resistance by other service-providing organ- * 
izations that perceive that the demonstration will have some 
negative impact on their activities. To the extent possible 

actions taken- by organizations that; impact the dlinonst^ation 

V. 

should be documented. 

Legal or regulatory impediments should generally be 

••' ■ I ■ ' • r 

identified very early in the project. These might, include 
regulations by government agencies such as tile FCC, copy- 
right laws or privacy laws. ^ 
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1 '^sessms nt of Benefits * Assessing the benefits of 
telecommunication* demonstration projects is a particularly 
troublesome task. Often they are not quantifiable or even 
easily observable. Frequently benefits accrue indirectly 
from action taken as a result of improved access to infor- 
mation^ made possible by the telecommunications based service. 
Benefits of a demonstration system may be assessed at several 
different levels. For example, the use of a telecommunications 
system in the management of regional blood banking, such as 
that being demonstrated by the Tri-State Red Cross Blood 
Center, may have as its primary ^nefits the reduction in 
time in locating and distributing blood on 'request. These 
may be measured in terms of minutes saved. But the ulti- . 
'mate benefit may be /that the time reduction plays a part in 
saving lives. These benefits are not easily measured. In 
this section of an evaluation report the benefits to service • 
delivery of the project's use of telecommunications are to . 
be documented. These may, of course, not be' evident until '"• r " 
the project has been operating %or several years,- 

Wherever possible, quantifiable measures of benefits 
should be used. The following are examples : 
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• v oost laving! 

• dollars par transaction, program pr 
othar unit of sarvioa 

- dollars par oliant 

- total dollars 

\ 

• productivity gains 

- voluma of information par unit 
of tima 

- units of time saved 

- reduction in units of labor input 

m access 

* number of (potential) Additional 
clients served 

— total volume of information available ♦ 

Of course, there are many other measures that may be used. 
Care must be taken to ensure that the measures that are 
chosen accurately describe the service benefits received. 
For example, additional hours^of specialized radio programming 
for the handicapped are not benefits unless there is an 



audience that listens to the broadcasts. Demonstration ^ 
outputs do not necessarily translate into service benefits. 



The assessment of benefits can be organized according 



to the following three points: 
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• Identify the benefioiariee of the project 
(e.g., olients, service provider*, admin- 
istrators) And doioribo how inform* tion 
services provided through tho demonstration 
were previously provided. 

e Present evidence demonstrating gains/losses 
of methods and technologies employed by the 
project over previous methods and services. 

e Present evidence illustrating the compar- 
ative advantages (and disadvantage!) of 
technologies and services of the project 
versus other available technologies and 
services. 



Strategies for Institutionalization and Transfer t Two 

of the ways in which the Telecommunications Demonstration 

Program can promote the use of telecommunications in social 

service 1 delivery are to encourage projects to continue 

operating after Program funding is withdrawn and to 

transfer the demonstration concept to o^her locations that 

face similar service delivery circumstances* In this final 

section of the annual evaluation report, the grantee should 

articulate the role it intends to play in the institution- 

alization and transfer process. At the end of the first 
; \ * 
year these strategies may not yet be developed in detail, 

but by the end of the second year a fully developed plan 

should be articulated. 



The approach to a strategy for institutionalization 
is essentially a plan to obtain revenue for continued and/or 
expanded operation. That plan can vary depending on the 
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tfcsust ^ project such as 

the cohtinuing educa tibn network being attempted by the 




depends on •genera viewers • in this ca^e 



the strategy for iristi t utionali zation^ amounts to a ; ^ 
marketing plaii^bh a statewide , or at least regional v 
level". Such an effort is no small vuxdertaking # requiring v 

■ ' • .! ' .• "*:'"' ' ' .'• ..'. '.'!. ' '•" ". •/'..*• *•/ '' "' ' ■ '. ' •' , ' • 

substantial resources and a good deal of -planning. ' 
In contrast, a project such as the Western Alabama ' 
Emergency Medical Services Demonstration may involve 
a strategy for obtaining operating funds by getting budget " 
,^ommitm 6 entsf from various agencies or institutions . In* 
this case, funds might be obtainable from servioe program^ 
in DHEW or directly from the participating hospitals. This 
approach, however, is ' clearly different -f roiti the one - 
required of 'Pennsylvania jState University. 



In addition to specif icplahs for generating revenue/ * 
the institutionalization strategy should take into account 

othejr barriers that might inhibit long-term operations. V 
Such barriers may be encountered as* part of the 

....... . ' • • t ' J f j. ' ! 

demonstration but possibly, at a smaller scale. It will be 
necessary in this portion of the report to identify any 
such barriers and the plan for surmounting them. As discussed 
'earlier, these may be io'f a technical, organizational or 
legal nature. 



r In addition, the^rfeport should describe a plan of 

actibn for the .pro j ect 1 s effort in helping to get the* demon- 
station con^ 'into use in other locations This, is .« 
also ijorm of marketing. In developing the transfer 
strategy, the grantee may want to consider , the following 
activities:. v, ,\ .-./," . 

*.. Identification of other target loca- 
. tiohs with similar service needs as 
those for the demonstrations. 

• Identification* of key individuals in 

x those target locations to contact; - 

• Identification of target groups or 
audiences that would have an -interest 

in, -the demonstration pro ject and the ' 

> appropriate means for contacting those ■* >' 
audiences such as: * 
■ • " , • ' * . ■;. ■ ■ 'V : ; ; ■ ,;■ ■ . . ■• . ; ' ( • 

'-. presentations at conferences 

- attendance at regular meetings 

- distribution of literature 

describing the project. * 

Finally, this section of the report should consider the 
cost of carrying out the proposed strategies. As discussed 
above, marketing efforts to end users can be an expensive 
proposition and must be planned. * 
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• 1.0 . - ' INTIWDyCTION:' ■ : \ ;: ' : - 

This report presents a method for assessing the cp^ 
of telecoimunibatibns The method is 

•.^^p^unded in ia 

• sufficiently yerg^ 

it can be applied to a wide variety of tech- 
nologies - aiid; s 
• A >necessary in£ oration on costs of a project 
to be useful in decision^making; 

• takes into consideration the unique charac- 
teristics of telecommunications demonstra- 

. . • jbions; and ; ■ 

• focuses on providing Information needed by 
several audiences including^ system operators/ >. 
funding agencies and others' interested in* 

< conducting siinilar projects or providing :: _ 
similar services. - 

Decision-makers are frequently faced with situations in 
which choices must be made from among several alternatives. 
Methodologief : "have been developed to assist decision-makers 
in . i - denti f ying the alternatives that a're the most efficient 
in economic terms. Principal among these methods are cost- 
benefit analysis and cpst-ef fectiveness analysis.. Cost- 
benefit analysis entails valuing the benef its or output "of 
an alternative in monetary terms and directly comparing 
benefits to costs. Any alternative which generates benefits 
in excess of costs is worthwhile for a society to undertake . 
When several alternatives are compared, the alternative that 
generates the largest benefits to cost ratio is the most 
efficient alternative. Because costs and benefits for all 



alternators are Expressed in one measure (dollars ) > com- 
, parisons among alternatives are easily made,' Cost-effective- 
nes s arialys is; in contrast / does not rely on valuing benefits 
in monetary terms ^ ; Ins tead, costs are compared to non-monetary 
measures of output such as numbers of recipients , volume of 
information disisfeminated / or time reduction for service deli- 
very. This provides a means of comparison, although direct 
comparisons of alternatives often are not possible. Two 
alternatives may have slightly different outputs, so*^hat 
effectiveness measures are not commensurate. 

In the telecommiinicationp demonstration context, cost- 
benefit analysis is difficult to apply. Telecommunications 

demonstrations, particularly ones focusing on social service 

. . , . ■ .. ■ . ; ''' •'" "■ ' ■.. ■ ; : - ' V • 

delivery, provide information services. The monetary value 

of public information is very difficult, if not impossible , 
to determine. Benefits to society do not accrue from the 
information itself, but rather from the action the information 
precipitates. To cite an extreme example, conducting a cost- 
benefit analysis of the use of telecommunications to provide, 
simultaneous transmission of voice and -biomedical data from 
remote emergency medical sites to a hospital would essentially 
require determining the value to society of saving a person's 
life. Obviously, in many instances the monetary value of 
ip^rormation is not easily determined. 

The use of cost-effectiveness analysis in the demonstra- 
tion context has; its difficulties as well. The primary 



limitation is that demonstrations are frequently innovative 
cyid there are no directly cbmpkf able alternatives. Thus; 
no determination can be made of the relative cost-effective- 
ness of the project. 

An additional difficulty is that the cost-effectiveness 
techniques that have been developed are applied to large ■■' 
operations systems. Sophisticated statistical techniques <" .■ 
such as multiple regression or path analyses aire employed 
in conducting the analysis. Those techniques require a 
rather large data base developed for a large. population oyer 
a number of years. Telecommunications demonstrations are 
funded for a limited time period and usually include a small 
population of recipients or clients. Thus, the data base 
generally needed for a full-scale cost-ef fectiveness . analysis 
cannot be generated. Still/ the notion of systematically 
comparing costs to output is an important one, and is necessary 
to obtain some measure of effectiveness. The method discussed 
below focuses on the cost-effectiveness concept and uses some 

. . ( ' V\'V-.\ 

simplifying assumptions J:o avoid some of the difficulties 
mentioned above. J 

There is another important consequence of the uniqueness 
of a telecommunications demonstration. As a one-of-a-kind 
system that must be assembled in a short time firame using 
technology that is available, the costs associated with 
the project may not accurately reflect the costs of an 



operational system. In such situations it is still necessary 
to examine the potential costs of an operational system, 
although in many cases this can only be done qualitatively. 

In. addition to the need to provide cost information for 
analyzing alternative systems, there is another important 
reason for conducting^ cost analyses. Demonstration projects 
may yield very positive results , and it may be desirable to 
expand the existing system. Also, other organizations may 
* want to develop the same, or similar, service systems. Cost 
analyses can be instrumental in planning the expansion or 
transfer of the system or concept. This requires examining 
costs froin a different perspective. For example, in trans- 
ferring the system a project manager would heed to know 
about the amount of initial outlays required to establish 
the service and the budget required to sustain the service. 
A manager of an existing system would be interested in 
determining whether the potential exists for cost savings in 
system expansion. (This is also important for analyzing 
cost-effectiveness.) The method discussed below takes .these 
needs iAto 'account as well. ^ 

The method for analyzing costs is presented in Section 
2. The presentation focuses on three questions: # 1 

• What costs. are.. to be considered i;n cor^ducting 
a cost analysis? '■ 

• How are cost data best organized for later 
analysis? . 



How are the data pseful in evaluating 
telecommunicatons demonstrations? 
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2.0 /COST ANALYSIS METHODOLOGY 

■' . V. . . * ' . .• '" ■_ ■ ■■' 1 , 

The methodology presented below is organized around 
four major elements of analysis; 

• the determination of true costs; 

• the disaggregation of costs by input and 
by time; 

• the sensitivity of costs and output to 
variations or substitutes for inputs; and 

• the, consideration of technological charac- 
teristics of the demons tratipn. * 

An analysis *6f the economics of demonstration projects 
ds designed with certain, goals in mind. Principally/ these 
are consistency, replicability , and clarity. To be able to 
accomplish these goals, we need to know the '■true" costs 
associated with the design, implementation, and operation bf 
the system! Being able to Identify tlie true costs plays a 
central role in the cost analysis . 

Costs must also be viewed in sufficient detail so that 
key components of the demonstration can be examined. Thus, 
it is necessary to examina the costs of individual inputs 
(labor, equipment , communications) , as well as how the cost 
of inputs vary throughout the duration of the project.,- 
Technology is central to telecommunications demonstrations. . 

■ ■ fr - 

its role in each demonstration should be separately discussed 



and the cost considerations of substituting other technologies 
explored. ; ' ■ 



The comparison of system costs and outputs is the key 
ingredient to the assessment of cost-effectiveness . Conducting 
this comparison ty project phase also provides insight into * 
the sensitivity of costs over time. The following sections 
discuss each of the methodology components in more detail. 

2.1 The importance of True Costs 

In new and innovative projects non-standard designs 
and equipment ,are frequently utilized . Similarly , managerial 
and technical talent is often "lent" or freely given to the 
system operators by individuals and organizations who have a, 

benevolent view of the goals of the new project . However* 

• ' . - • ' : . - "■ " '"■ • • ..■_•< " "• ' ; 

useful, thid may be to the' project itself , both from ifche point. 

of view of society and from that of others who might duplicate 

the system in the future, gLt is important and necessary to 

know the full magnitude of the costs of the resources used by 

the system. . 

To the economist, the only appropriate measure of true 
costs is what are termed "opportunity costs" the value to 
society lost by using each resource (plant, equipment, labor) 
for the specific project being analyzed. This value is 
measured by determining alternative uses of the resources and 
looking for the one with the highest reward to society. In 



t£e case of goods and services purchased on the open market* 
the opportunity cost is the same as the price paid. That is, 
the value of a good or service to society can be directly 
determined from the price people are willing to pay.' Diffi- 
culties arise, however ^ when goods or services are not 
obtained through market transactions. For example, space 
for the project may be donated, as occurred in the TALINET 
project-, or workers may be willing to accept wages below 
the going rate, as in the project conducted by the Deaf 
Community Center. In these cases, we use opportunity costs 
as the only reliable measure of the true costs of these 
resources to society, in the case of the donated space, 
it is necessary to determine how much revenue such space 
would bring if it were leased or sold on the open market/ 
Likewise , we -need to determine what level of pay the workers 
would receive if they accepted the best alternative job. 

Although the rule is basically quite simple — to attempt to 

■ * 
.determine what the true cost to society is the application 

may be more or less difficult depending on the nature of the 

resource in question. 

M A second problem that often arises- in cost analysis in 
the social service delivery field is that volunteers may be 
relied on for particular services. In addition to providing 
assistance in the construction and operation of the project/ 
volunteer help is often used in the development and actual 
production of programming utilized by or presented on the 
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system. Thi§. situation occurred in the CenTeX Special 
Conununicatibns Services project. Ovof forty part-time 
volunteets wers used to produce programming for the project 

Evaluating the opportunity costs of volunteers' time and 

p ■ \ . \ . . ■ 

effort isl difficult n for several reasons: 



equally skilled labor may not be Available 
at any price; » ) 

labor with a different level or. mix of skills 
might be used if the project had to hire 
replacements; and 

the volunteers "may have no alternative . 
paying outlet for their skills. (This was 
the casq^&r^^ny of the elderly volunteers 
in the keaSM fc^ehnsylva^ia interactive 
cable TV e^mlt.) 



When the^e and similar problems arise in the DHEW 
demonstration projects, it is important to point out their 
existence and develop either a best estimate or a set of 
alternative estimates of the true system costs. 

The third problem that may arise is presence; and 
magnitude of any "hidden" costs. The major category^ of ? 
hidden costs is thojse costs imposed on others , by the ' 
existence and operation of the system. For instance, other 
functions Carried out by the particular project may become 
more costly because certain commonly shared resources are 
now more costly to obtain or use. In the educational 
television network demonstration* conducted by Pennsylvania 
State University, for example, the broadcasting facilities 



used for local educational programming are also to be 
devoted to network broadcasts. Funds to oover broadcast . 
time are not included in the demonstration grant, but are 
hidden in the operation of existing university services. 

Another category of hidden costs that must be con- 
sidered is the one that donsists of resources made avail- 
able to the project without charge by government agencies 

> 

or supporting institutions. Although it may appear as 
though the true cost is actually zero because a charge is 
never made for these resources , the case can be made that 
a charge should ,^ nevertheless , be imputed. .To cjive a 
specific example, several of the projects' use portions of 
' theVelectromagnetiQ spectrum. These frequencies are 

. _ . * £f 

allocated without regard to their scarcity value and the 

0 . "... * - 

fees levied are often quite small/ Nonetheless, use of 0 
the spectrum by the projects may force other services to 

,use less desirable frequencies or prevent them f^om being 
offered at all. When this problem arises, it should be 
indicated, although there is no widely-a,greed upon way 

<of handling these costs. 

* ■* 

To summarize and restate the basic principle we have 
discussed in this Section: when properly conducted, a 
cost analysis will ^Include the true costs of all resources 
used. In almost all circumstances, the measure of these 
true costs will be the opportunity costs — the value of the 
resources in their best alternative uses or in the* marketplace. 



2.2 Categorization of Coif 

a " 11 i ■ . ■■ ■ ■■ ■ 

The previous section described, conceptually, the 
.nature of the costs that should be examined in conducting 
a coat analyaiv. This section discusses how these c,6st 
measures might be usefully categorized and how one might 
use the various categorizations. A format for organizing ' 
cost data is presented in Appendix A. There are several 
generally recognized types of costs that may be considered 
including: 



/ • Fixed Costs ; costs that do npt change" 

with the level of system utilization. 

• Variable Costs : costs that change with 
the level of utilization. 

• Recurrent Casts : costs incurred for ^ome 
item that is used at the time of purchase 
(e.g. , ^easing of computer services) , but 
for which the same costs are incurred 
again for each ' spec! fled time period . 



f 



Capital Costs ; costs incurred to purchase 
plant or equipment that is used beyond the 
time of purchase for its lifetime. 



/ 



Frequently, capital costs are confused with fixed co£ts 
because both are associated with equipment and plant purchase 
However, fixed cost£ may include such items as maintenance 
or administrative labor if they do not vaty with system 

utilization. These fixed costs Irtay also be considered 

' ' *■ ■ < 

recurrent costs because both administrative, labor and main- 

tenance may be purchased^ for a specified tike period. " 



, jl 

The** -types of costs may be examined by time, input, 
■ N j • • • 

end function. No one of these is necessarily better or 

woree then the others; "the only test ie how useful they ere 

and how much information they provide in analysing the coete 

of each demonstration. 

By' time : Any communication* ays tern can be expected to 
have certain set-up costs that must be incurred before any 
operations are begun. These include capital investment in 
plant and equipment, purchases of initial supplies and 
programming, if any, and the wages and salaries of the per- 
sonnel necessary to initiate operation. 

There are other recurring costs that will continue on 
a regular basis ev^n after* all the plant and equipment are 
in place. These may include communications services and 
other utilities , operating personnel , and other costs incurred 
because of the ongoing nature, of the system's operation. 

Rather than utilize the rather crude division of time 
into the two periods set-up and operation — four phases 
should be employed in' an effort to capture more useful 
information about a demonstration project. The four phases 
are : 

* ■ ■ v 

1) installation and start-up , 

^ 2) trial operatidn, 

3) demonstration , and ' > 

4) institutionalization. 



Each of th^se project phases represents a different ... 
mode of operation of the system, and it can be ejected that 
the nature of the co^s; ipay be quite different in each. . For . 

example , in the f i rs t phase we would expec t ai ma j or part of 

' V; '■' • • ; •• | ;*v ::; :-..- v. V 

the expenses to be on the equipmenj^or thfc central 1 

site 'and. on some of the equipment for those who wjj.1 be 

utilizing the service . . In later periods the costs :6f ^quip- 

ment might be a relatively smaller portion of total expenses'. 

• * The operation period is sub-divided into the trial 
operations, demonstration, and institutionalization phases 
because ijt is likely that the nature of the costs will be * 
sensitive to the number of users, the level of experience 
of the system operator, the types and quantities of pro- 
grcunming, and other factors that may change as the system 
develops . v 

**** t 

The following "short" definitions of the three operating 
phases can be used in gathering cost data for a project: 

• Trial Operations : pilot test of service 
delivery// 

• ^ Demonstration ; ' full operation of systems 

to a majority of the intended users . 

• Institutionalization : successful ongoing 
"deli-very of • services and (at least) partial 
self-suf f iciendy . 

Unfortunately, exact times when a specific project will 1 
move from one phase to the next cannot be prescribed. This 



can cause a certain degree of nbn-coirariensdrability between 
the various projects, as slightly different standards or 
- definitions may, be used. As long as the system operator is 
careful^^ explain how the dividing lines were drawn/ the 
impact of any inconsistencies in defining the starting and 
ending points of the various phases is likely .to be small. 

Having information on the time-phasing of the costs 
can be useful for several reasons. Primary among these is 
that both profit and non-profit organizations place a 
premium on expenses that must be incurred sooner rather 
e thaa*i later. By postponing expenditures , the organization 

• 4 ■ 

can earn interest on the funds that are * not being currently 

used. As a result, expenditures to be made in the future 
are effectively reduced.— V \ 

A A related concern is the impact of the expenditures 

( on the cash-flow of the organization. It is useful to be 
able to predict the approximate times at which funds will 
be required so that plans can be made in advance to have 



1/ , ♦ * / 

— We will not go into a detailed /presentation of the 
theory of the time value of money and discounting 
future costs with the interest no t$ here. For more 
on this^to^ic;; see D.T. Jamison/ S.J.' Klees and S.J. 
Wells, Cost Analysis for Educational Planning and 
Evaluation: Methodology and Application to Instruc - 
tional Technology , Agency for International Develop- 
ment, Office of Education and Human Resources, January. 
1976, pp. 13-19. 
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those funds' -available • This is particularly importarit 
where there arevdong lead times in. the funding process . 

By input ; It is possible to characterize any par- « 
ticular service by looking at either its inputs or its 
outputs. For information and teleconunuhications services, 
it is often quite difficult to develop output measures that 
allow for 'a^BO Rpj^ate ht' comparison across projects . However , '•• 
this is not a major problem for demonstration projects that 
are acknowledged to be unique* For such projects/ we are 
not always interested in a direct comparison of the outputs. 

On the other hand , being able to compare the mix of 
inputs used by each of the projects is useful. To do this , 
we need information on the configuration of the system, the 
operating requirements (both labor and other necessary inputs 
such as utilities and supplies), and the space required. ^The 
obvious solution to the problem of how to aggregate and 
then compare these numbers is to collect the cost data for 
each type of input. 

Specifically, the total costs of t]ie inputs can be 

disaggregated into six categories: ' 

* » 

• equipment (purchased or leased); 

• communications and computer services 
(purchased or leased) ; 

• space; ...... 



• labor (admini strati vie and operating); 

• programming and software; and 

• miscellaneous. 

Aiii& division of costs into categories is arbitrary to 
some degree. However , these speci fie categories are chosen 
to provide certain types o y f x ln formation to system operators , 
funding agencies, and evaluators • \ For example, the space, 
equipment, and software categories individually and together 
provide information on the fixed cos ts^— those costs that , 
are relatively independent of the level of operation of the 
system. Conversely .the levels of communications or computer 
services and labor may vary systematically with the volume 
of usage of the system so that total variable costs can be,. '* 
examined. It will be useful to determine these relationships 
as their character can provide information about what costs 
we might expect for various levels of system operation. 

By function : In addition to the usefulness of cost 
breakdown by input categories , additional information can 
be obtained by using the breakdowns of costs ,by time and 
by input in combination with one another. As an illustration 
it is possible to determine if virtually all of the equip- 
ment and software^ costs are incurred in the start-up phase 
or if a significant portion of these costs continue ihto 
the operating phases. 




2. 3 Sensitivity Analysis of Cost Data 

There are three other important .ways in which the 
information described above can$Jfe used by researchers or 
administrators . Cost data can be used to : 



• analyze the sensitivity of total costs to 
changes in the configuration of the system 
or in the prices of any inputs; 



• analyze the sensitivity of the cost of out- 
put as system utilization increases; and 

• obtain some indication of system cost- 
effectiveness when the\costs of alternative . 
modes of providing information 'services are 
available. 

Conducting a "sensitivity analysis" of costS^afid inputs 
can provide insight into which of the inputs %an "be varied 
without any major effect on the level of total costs. The 
degree of sensitivity of total costs to changes in the l 
price or quantity of any one of the inputs will depend on 
several factors .Among these are the proportion of total 
costs accounted for by that input -and the degree to which 
oth^r inputs can be substituted for the one in question. i 

As mentioned earlier/ demonstrations are often uniaue 
and there are no alternative systems that can bfe used for 
comparison. Thus no opportunities exist to examine the 
cost-effectiveness of the system. This sensitivity analysis , 
in effect, is a substitute for the replications of the demon- 
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stration projects that do not exist. With unlimited funds 
we would like to design several alternative systems, each 
somewhat different in configuration, but accomplishing 
similar goals. This idealized approach would enable us. to 
determine which of the various configurations were more or 
less efficient, or which had relatively high capital require 
ments. However, the nature of demonstration grants is such 
that each system is usually one of a kind. Therefore, we 
use the sensitivity afnalysis to predict the likely effects 
of the changes that, in reality, we are unable to make. 

A second type of sensitivity analysis involves exam*- 
ining the relationship between changes in system costs and 
changes in the level's of output of the system. This sen- 
sitivity analysis is known as marginal cost analysis. 
Where the analysis mentioned above was primarily concerned 
with the effects of changes in the level and mix of the, 
inputs , here the concern is fpcused on the consequences of 
changes in the volume of the outputs. This analysis 
requires additional information on the output of the 
system produced in eaqh of the project phases. A format 
for organizing output data is presented in Appendix A. 

There are three more definitions of costs that must 
be considered. These are: 

• Total Cost t the total amount of money 
spent on the project. 



m Average Cdst : the total cost divided by 
the number of units of output . 2/ 

m Marginal Cost : the cost to produce an - 
additional unit of output. ,.' 

Marginal cost analysis is of major importance, in 
evaluating the costs of telecommunications projects. To 
explain why we concentrate on marginal costs, consider the 
simplest case — that of a system with a single output. 
In this situation there is a unique relationship between 
changes in the marginal costs with changes in outputs and 
the existence or non-existence of economies of large-scale 
operation. Specifically/ if the marginal costs are declining, 
it is less expensive per unit of output to produce at a 
greater level of output than at a lower level, although the 
converse is not true. There are "economies of scale" to be 
realized in operating systems of increasing size. 

' * * f . 

In the single output case we can also uniquely define 
average costs or the total costs divided by the level of 
output. This enables us to defind' three cases: 

0 when average costs are declining (and the 
marginal cost is below the average cost) , 
there are economies of scale (economies t 
of large-scale operation) ; . 



t This definition applies when the system can be 

reasonably thought of ^as generating a single type 
*■ of output. ' - " * 



•when average costs are increasing (and the 
marginal cost is above the average cost), 
there are diseconomies pf scale (increasing 
unit costs with larger , scales of 'operation) ; 
' • " • -and ,V'^^V" ■■ .. • 

« when average costs are constant, neither 
increasing or decreasing (and the marginal 
cost is equal to the average cost) , there 
are no cost advantages from either larger 
or smaller scales of operation. 

Unfortunately, the analysis becomes more complex when 
there is more than one output. If the mix of the various 
outputs were to remain constant, we could continue to use 
the single output analysis by using multiples of the con- 
stant mix in place of the single output. However, keeping 
the mix constant is unlikely at best. As a result, additional 
considerations would have to be added in our analysis. 
Specifically: 



• changes in the mix of outputs may change 
the level of costs (even if the total 
level of output is held constant); 

• because total costs are dependent on the 
levels o*f all of the outputs, we can no 
linger uniquely define the average cost 
of each output; 

• nevertheless, we can still use the concept 
of marginal cost, but there is no longer 
any simple relationship between marginal 
Costs ^nd scale economies. 



Although the theory acquires a greater degree of com- 
plexity aV it becomes more realistic, it is often the case 
that we can abstract somewhat from the full complexity of 
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the situation to keep the analysis manageable while cap- 
turing the significant features of the system and its, 
market* For example , the CenTeX demonstration provided 
special broadcast services to several different handicapped 
groups. Although the form of output varied (some were audio 
and some were hard copy via teletype) , all of the services 
could be characterized in terms' of total broadcast hours. 
Thus, average costs could be examined in terms of the 
total costs divided by total broadcast hours, and marginal 
costs could be examined ih terms of the cost of an addi- 
tional broadcast hour. Under, this assumption, the analysis 
could proceed and inferences about the behavior of system 
costs could still be made. 

Admittedly , some detail is lost in analyzing the costs 
of individual services using this simplifying assumption. 
But the alternative involves a quantum leap in the complexity 
of conceptualizing the cost measures, generating the necessary 
data base and performing the analysis. Thus, wherever the 

" • ; ; < 

^, i " " 

single output assumption can reasonably be used, it should- be « 
applied. > 

■ a 

o . ■ • 

To; conduct this analysis, the output of each project 
phase is divided into the total cost of each, project phase 
to determine the average cost per unit of output by phase. 
These several average costs can be examined to determine 



whether average cost declined as system output increased. 
When this occurs , marginal costs are declining and economies 
of scale exist. Where average costs do not decline, the 
indication is that there are no cost advantages to operating 
a system larger .than the demonstration project, given that 
^system's configuration. 

The two types of analyses discussed above focus on 
the sensitivity of the relationship between costs and inputs 
or outputs. Using data developed in the analysis of marginal 
costs, a fchird analysis may be conducted. In particular, 
some conclusions may be made about the cost-effectiveness of 
the system if data on comparable alternative information 
services are available. Data on the average costs and/or 
marginal cost of output, for the phase of the demonstration . 
that most closely approximates a fully operational system, 
can be compared to the commensurate costs of the alternative 
system. The system exhibiting the least cost per unit of 
output is the most cost-effective. 

In some cases, the demonstration may be designed to 
examine the costs of alternative technologies. This was 
true of the TALINET project. Data generated during that 
project could be used to directly compare the costs of 
information delivery using two different telefacsimile 
systems. However, very often data on alternative delivery 

+> 
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modes is not available and such direct determinations of 
cost-effectiveness cannot be made. 

> 1 , ■ ■ 

2.4 Changing Costs of Technology 

• * i 

One of the goals of demonstration projects is to 

introduce new technologies in the provision of specified 

services. To assist in determining. -the usefulness and, 

desirability of these new technoldgies , 'it is important to . 

know how the costs of the project are influenced by the 

choice of technology. This is made difficult by two 

factors: . 

• each project is usually one-of-a-kind 
and the same services are not provided 

' by alt^rnat^v&^t^chnologies; and 

• becausernew technologies are utilized , 
their costs generally change rapidly 
over time. * ^ 

In some cases, the demonstration project is designed 
to do tasks or provide services tha& have been accomplished 
by alternative means in the past. In these situations, we 
ideally wou^d be interested in knowing the costs of pro- 
viding the Same level of services by each of feasible 
alternative delivery systems. We would also be interested 
in any qualitative changes on the providers, on the reci- 
pients, and on the services themselves. In the absence 
of these alternatives, the evaluation design is useless because 
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it relies on non-existent comparisons. We are forced instead 
to use hypotheticals as comparisons or to develop measures 
of acceptability and efficiency that are based solely, on 
information obtained from the project and its environment 

alone. The use of a hypothetical alternative is employed 

i - 3/ 

in the CenTeX case study. In that analysis, the assumed 
costs of a newsletter were compared to the costs of providing 
a teletype service for the deaf- • " , 

The\recond problem related to the use of new technolo- 
gies is of* a different nature. It arises because , the costs 
of performing the various tasks or of delivering services 
ajge likely to change as the personnel learn to use the 
system more efficiently and as the technology itself becomes 
more widely available. /These two phenomena are widely 
documented. The first £j9jcharacter±zed by the "learning 
curve" — a reduction in the marginal costs as the personnel 
become more experienced. The second may also be a learning 
curve phenomenon on the part of the producers of ^the equip- 
ment or represent the effects of economies of scale. What- 

ever its cause , the analyst and decision-maker should 
recognize the fact that any cost estimates may only provide 

» , v > \ 

information about the recent past, and estimates should be 
used with care. 

The final task in conducting a cost analysis of a ^ 



3/ . u 

— ' ^ See Appendix B. ~ _ 
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telecommunication* demonstration is to make some assess- 
wnt of the potential for growth and transfer of the service 
demonstrated through the project-. This assessment will 
result from a synthesis of the observations made during the 

i ■ 4 > 

analysis and will roily heavily on cost trends demonstrated 

in the 4 project. , For example, are economies of scale present, 

' ■ ■ * 

or are average costs exceedingly high? It will* also require 
. the analyst to consider the cost trends of the technology 
employed. Do industry trends show production cost reductions? 
How significant are expected decreases in the cost of pur- 
chasing the technology , and ..how can any such cost reductions 
be expected to reduce costs- of serviced delivery? More 
baa/ically, how important are the costs of technology as 
compared to other inputs for service delivery foi: a fully 
operational system? Questions such as these ^can be used tp 
draw some conclusions from the cost perspective concerning 
the prospects for adoption and expansion of * the system 
demonstrated. 

2,5 Summary 

The purpose of a cost analysis of a telecommunications 
demonstration project is to provide economic information 
to administrators and project managers who are considering 
alternative uses of limited resources for providing infor- 
mation services. A method for analyzing the costs of demon- 
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atration projects must bo versatile enough to bo applicable 
to a wide variety of technologies and oervice applications. 
It must also provide information that is useful to agency 
administrators and project jftanagere at' the same time. Such 
a methodology has been described above, and consists of the 
following steps: ^ 



o Determine the true costs of the -project. 
True costs, in edonomists' terms, are the 
opportunity costs of using scarce resources. 

• Gather cost data by type of input and pro- 
ject phase. (See Appendix A) . 

• Gather data on project output by project, 
phase. (See Appendix A) 

• Analyze the costs by input and by time to 

[ examine characteristics of the system such 
as requirements for fixed cost and variable 
costs. 

Analyze the sensitivity of project costs to 
changes in the configuration of the demon- 
stration and prices of inputs. 

• < . »> 

Analyze the sensitivity of the cost of pro- 
ducing system output as utilization of the 
system increases. \ 

• Where sufficieAl: data s are available, compare 
the average costs of QUtput for the demon- 
stration to alternative means of providing 
the information service. 

• Consider the .co'st trends, in the industry 
that produces the technology used in the 
demonstration agid assess the potential 
effect of expected changes in the cost^of 
technology. 

• Based on the above analysis, draw conclu- 
sions about the prospec€s for adoption and 
growth of the system demonstrated. 



In order to. help DHEW evaluate the costs and effectiveness 
of your project, we are asking for certain cqst information in 
a manner that. will be consistent across all DHEW- funded demon- 
stration projects. We are aware that in many cases^ costs may 
be difficult to/ calculate or allocate, so we are only asking 
that costs be broken down into six categories and as few as 
two time periods, f i s 

, • . .-»...... • • 

• • ■ " . 

. • * : ( 

Tf, because of the special features of' your system, yoy 

■ .■■ ' . \.\ - - 

. believe that we should have costs broken down more fiffely or " 
,'"»*•. i ■ , . ■ ■_ 

in a different way, please try to use our categories and -attach 

a note specifying the alternative categories you would like us 
to - use. ■' f \ :■- t - 

We have divided the contract period into four phases: 

(1) start up and installation (vs. delivery of services); 

(2) trial operations (pilot test of service delivery) ; 

• (3) demonstration (full operation of systems t^maj.ority of 
^? lt ? n ^® < l : ^ er ®) '» WXii^*^1 6 S tt ' on ! alizati P n (successful ongoing 
of services: andl^ari^al self-sufficiency) Please 

P ^ ^P e care * u *^o nsi <te the costs and try- 

^ ; ! '^o allocate thq co^t^^j^d^riate to each phase. ••• 

iV .... V'"','^ - , * 
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System Cost Analysis Questionnaire 

We are also asking for measures of ■ the volume of usage of 
your system* For example/ give us the number of messages ^seg- 
ments, or programs during the same time periods used for' the 
breakdown of costs. (Do not worry if there was no usage or 
output during tfle installation phase.) We have allowed room 
for more than one measure of usage if this is appropriate. 
-If you can, tell us both the number of programs (or messages) / 
and the total time, please do so. 

Please fill the form out to the best of r your ability and 
return it to Us by May 11, 1979.- Feel free ko let us know if 
you have any questions or suggestions for improving the quality 
of the information. 



COST SUMMARY 



Time 
Periods 



Cost 

Categories 



Installation 
•arid start-up 

from- 

i>tO:V'> ; '.^'-'"',:^-. 



Trial 
operation 

front 

to . ■ 



Demon- 
stration 

from ■ 
to 



Institution- 
alization 

'from ' ' : ; . 
to • ■ 



1. 'Equipment 
(purchased 
or leased) 



2. Communications and 
: computer services 
(purchased or leased) 



3. Space 



4. Labor 

(administrative, 
operating) 



5. Programming/ 
software 



6. Miscellaneous 



TOTAL COSTS 
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COST DETAIL 

1 . Please give details on major equipment items and costs : 



2 Please give details on communications and computer services 
expenses: 



3. Please give details on programming and software expenses: 



4. Please give details on other space required and used but 
not paid for: 



5. Please give details on labor required and used but not'' 
paid for (man hours) : 



6. Please divide labor into administrative and operations: 
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tfime , 
Periods 



ear 

tires of, 

peiatirio Voliimft 1 



Measure #1 
(specify)) 



4- 



Measure #2 
(specify) 



Measure #3 
(specify) 



Installation 
and ,s£art-up 



operation 



Demon- 
stration 



Institution- 
alization 



Form filled out by 



(your name) 



See the attached sheet for specific instructions, when completed, please return to: 



John H. Clippinger 
Kalba Bowen Associates 
12 Arrow St. 
Cambridge, MA 02138 
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APPENDIX B 

Coat Analysis Methodology 
Selected Case Studies 
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1.0 COST ANALYSIS METHODOLOGY - SELECTED CASE STUDIES 

The eight telecommunications demonstration projects 
included in Kalba Bowen's analyses were each asked to 
provide the sliudy team with cost and output information.-^ 
Six projects responded, including: 

• CenTeX Special Communications Services, 

• University of Denver, Graduate School of 
Librarianship - TALI NET, 

• Deaf Community Center - Computer-Assisted, 
Telecommunications for the Deaf, 

• Western Alabama Emergency Medical Service, 

• Pennsylvania State University - Continuing 
Education" Cable Television Network, and 

• Wernersville State Hospital - Interactive 
Cable Television. 

Of these projects , only the first three listed above 
had progressed far enough in their first, year to generate 
sufficient cost and output data for a cost analysis, A 
separate case study, following the basic methods discussed 
above, is presented below for each project. Different 



^ Data provided by the projects in the format shown in 
Appendix A (System Cost Analysis Questionnaire) were 
the basis for each of the analyses. However, as each 
demonstration was studied, additional questions were 
asked to members of each project staff and additional 
data were obtained. For /example, questions were 
posed to staff members to obtain more information in 
determining the true cost of the demonstration. The 
use of additional information is identified in each 
case study where it is employed. 
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components of the method # however, receive varying emphasis 
depending on the unique characteristics of the demonstration. 

The latter three projects, which are treated in a single 
review, could not provide enough information to conduct a 
full cost analysis. Nevertheless, examining some basic 
characteristics of these projects yields useful observations 
about important 'factors to consider in designing demonstra- 
tions and selecting projects for funding.' 

- --- - - . : ~ /— ; : — ; 

In reviewing these case ^studies , it is important to 

note that they reflect project developments through October, 

1979, only. While events since that^tiyne may have altered 

an individual project's status, we believe that these case 1 

studies continue to reflect an accurate application of the 

cost analysis methodology proposed in the body of this 

report. - , 

( 

i 

1.1 CENTER FOR EXCELLENCE, INC.- Special Communications 
Services Project 

The Center for Excellence, Inc. (CenTeX) is a non- 
profit service organization that specializes in the use of 
communications technologies for increasing teaching effec- 
tiveness and for distribution of educational services 1 
The CenTeX Special Communications Services Project (SCS) 
has a's its primary objective the delivery of information 



services using the subcarrier, band of FM radio stations to 
three special populations i the visually impaired, the 
hearing impaired, and the deaf-bj^nd. In particular, special 
audio receivers are being used to provide service to the 
visually impaired; teletype machines are prpviding hardcopy 
to the hearing impaired; and braille teletype machines are 
to be used for the deaf-blind. The project has been success- 
ful in developing and providing -services for the first two 
populations , but not for the last — braille teletype ser- 
vices for the deaf -blind. CenTeX experienced difficulties 
in obtaining equipment, and did not find a sufficient number 
of deaf-blind clients in the demonstration area. yi 

Project Costs : The costs for the first full year of the 
CenTeX project were provided by the project staff. These 
are shown in Exhibit 1. The costs cover the installation 
*and start-up, trial operation, and demonstration phases. 
The project has not yet matured to the institutionalization 
phase. 




\ The CenTeX proj^g^$ spent five months in th$ start-up 
phase, approximately 2.5 months in the trial operation 
phase, and approximately 4.5- months in the demonstration 
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• ' ' Exhibit } 

i CanTaX ■ SCS Project 

\ 1 

i it 



COST SUMMARY 



4 

1 
1 

I 

/ ^ ' Til1 

• x Pei 
Coat 

. Categories ^ 


■\ 

6 

iods 


\ Installation 
\ and start-up 
V from 1/15/78 

\ to i/li/W 


1 

Trial 

operation , 
from 6/16/78 
to ■ S/31/7S 


* 

Demon- 
stration 
from 9/1/78 
to* ' 1/15/79 


Institution- 
alization 
from 
to 


Total 


1. Equipment 

(purchased . 
* or leased). 




$22,100 

' ■ i 

\ 


< 


- 




$22^,100 


2. ComwunicationB and 
computer services 
(purchased or leased) 


i 

■i 

6 i inn 
9 1,JI)0 


i ( __ 

225 


K 


* 


- 

2,025 


w 


-o- 


f. 




-0- 

' \ 




•Or 


1 

.4, Labor 
: (administrative, 
operating) 


'in 

$ 4,500 J' | 


/ 3,900 


' 1 

9,100 ■ 




17,500 


- 1 — i 

L, 

5. Programming/ 
. ^oftlare . 

' 1 


' -Or ..<■ 

i 


125 

*' 


( 250 


- ' N 1 - 

L. - 


' 375 


6. Mi^ellaneous r 


$ 6,750 . 


4,50f 


7,200 I 




18,450 


TOTAL COSTS' 

81 

a . 


$34,650 

\ 


8,750- ' 


17,050 




■ J 

. 60 , 4 50 
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&Ha*e. The start-up .^ase- ? wti. ; ,.the J mosb^^stely '' •; 
• ' ; both in total dollars ' u aM$&at&Tteikqi : -&6£l*ids\ spent 

ith.;. .Ih Jfotal, thp, star^u»h^^co^t r $3.4', 650, 



' ;'EHSr month 

,57 . :pe^c^n€--"'qf ' bhA>f i, 



or 



*7 



operation ^nd^eiiro^^ 15 an 

< -28> percent ,of total •.exflendit e8i ^ > - > 



ituirVs.v The trial 

and 



V iAto account dif f ef eni 



jT ^tart-up pl)ftse 



>n&Iti^ -Taking 
l the\length 6% #ach phase , 1 



e was- stil|;^$ rooi^o^^'lf^afl .average 



cost 



per fyonth basis ... Averigei costs ^easi^fi^lot^'-lhe start-up 
phase were approximately If , ? 9M % /fpfi#^t : r^)tj Average 



•• monthly ; cosfts, for the 
^ ^basically, the s*ame as 



f of vtKe/ Atrial . operai&birv 1 



' <. b^w© phases' " combined were 
5,taf trup phase . ; Monthly costs 

^werfe|'$;3-,. 50 0? for the '■ 



demonstration phas^e JKhe»; ; W ete • approximate ly $3 , 80.0 . 

> |The basic reaston'', for ^his .tirte^iltribution of costs 



can,, be s^en - by^amani^ex^n^^res the various cost 

,'♦ •• , ' '« V" v. - ' ';. '" . r • . , ■ ., 

.categbries.v In pa^idular4 equipment costs were incurred 

■>..• ;":y : ': : ;\'Si:- : ''"'y. - 

' v '^l^^fe^-'^ ' ^^t"^ P h ase. As seen in Exhibit 1, equip-,, 
ment, .cps.ts V€btalleS $22,100, or over 60 percent of the 

' *'. .'• '.• '*'•:•■ 'v' i' ■ ■■ i#> "v : .-.--.. • '~ : • ■ - A' ■ ; - 

start-up cpsts and .over: 35 percent of the' total costs for 
the project 'js firsl: year. This^ is a significant character- 
istic of . a broadcast system..; The studio facilities and 
broadcasting equipment must be fully installed before any 
services can^ibe gin. / Thus, virtually all projects of this . 

' ' " ... ■ ■ i • . 

* f/ • • ■ 

type will incur relatively high fixed cos'tif- early in the 



r-5 
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toroiect. k However; ; considering fixed costs in ,thev aBsolutfe, 
the cost of setting up an FM subcarrier system that can 
provide infonriation and .entertainment services to a poten- * 
tially large population in ^region is rather small, less 
than $25 / 000 r according €t? the CenTeX project data. 

. . £' .. ; . . . '"J 

r -•• • .-• h \ : ■ ... v ' r4 '.• •-rf 

In examining labor costs, a major component of variable 
costs, it >;pan be seen' that average monthly labor costs •> 

increased over time. - In the start-up phase , labor costs 

. s . .■• . ' '■ . -i / v 

averaged $900 per month. ; In the trial operation phase, the 

- .*'».■■ -.^v- •-. '• .• - 

' *■ • •* •■ ■«' k 

cost- .of labor rose to $1,500, And in the*'£empnstration phase 

labor costs were approximately $2,000/ per month. These 



variable cost increases arfe 



&' , ac ^^ s t4-£%-- 

attributable to the increase in program^ in 



each phase. Total broadcast houfcs ; increa'sedv^'rom 10 .5 liburs 
per week in ,the -start-up and ttipl opecatibn phases, to 40_ ^ 
hours per week in the dertfbrfs trationj phase. This increase in 
service* require^ larger inputs- of paid labor. •• — 



Additional, Costs : The costs incurjtffed during the first year 



■r' -'do no^f 'completely reflect, the true costT associajted with the 
SCS ^project. An 'important ^characteristic of this project. 



as With .many public service projects, is that its success is 
heavily dependent on volunteers. According to data provided 



^y ^CehTeX, the SCS project used 46 people who volunteered 
fi^t hours of labor during the first year. Additionally, 




tlTfes^rogram manager contributed an estimated 650 hours of 



time over and above those for wfilch she was paid* and 
approximately* 10 percent of the CJiief Operations Officer's 
time was spent on the project without direct charges for 
his time • Ixv^total thenV;,2054 hours of labor were 
"donated" ,di^|1fig the first year of the project. The 
estimated value of that labor is $11,900. (See Exhibit 2) ~ 

0 The SCS pijpject also incurred "no space costs for its 
first year , : although a studio/office using 250 square .feet 
was established for the project. The Estimated cost of this 

- : " ■ ■ ■". ■ ■ • ' . ; - . * ■■ ■ . •> 

V - v. ,., • ■ • . . ■ ; ■ , . . . . 

space/ if CenTex. had had to pay for it, is $2,750. 

If the pro je^b paid for these resources , the profile 
of project costs would J3e considerably different. Total 
project costs would have increased 24 percent. j^Xabor inputs 
would increase by 68 pe^ent> making them the most costly 
item- . 



This /p|^^^cliides-^n estimated value of. $|§|Z84 fd# ; '\ 
voliintfe«^^ai)br . Some argue that in using ^alunteers 
(6r unemp^itsyed persons), there ar$ no opporrtiiiaities 
foregone by society for ; that labor resource ; therefore , 
their opportunity ,( true), cost is zero, floweveir, . 4 

such projects "hiay not be able to rely on such a lar^e 
corps of % volunte^s^ The dollar estimate is presented 
here to reflect the. costs that would be incurred in 
that case'. - 



■ Exhibit... 2 . - . 



,/ :>4l PROJECT SGS^ X 

$ . " ........ 

Additipnal Labor and Space Costs 



; * • V. . 



Iitput v Volume Estimated 

of Inp 0 ut Value 

,* '■ : ' ■■■ . ' . ...... 
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I^BOR: ^J: 



ProcfraWi -ani^ ' vdltinteer Manager : 
. ChieE',Q]te;ratibn£ Officer. ": •:'/ •>''*. "■ ;> .. 



...-^ a/ 
65.0 hours „ ' '$3 , 6.40 • 

V ' ■■■ '■' b/ 
208 hours * : $3,4,94" 

r . . , \ . c/ 

196 hours $4,784 ~ 



• - . 250, sq. ft. . $2,7,50" 



•TOTAL: . ■ • '■ .$14,668 



TOTAL:- ,'v .-^ „- - ••' > 



>;>/'•; E.^tiiria^e based on $5.60 per hour. 

|: b y rf ; - . ,. 

\ — ; Estimate based on $16.80 per hour. 

■ ' ' ■ - '0h;*» 5 > t 7« 

- ^stiiriate based on cost of $ll per square foot per year. 

d/ w v v • 

- Estimate based on $4.00 per hour. 

. !>i'/ . * . 

-ft,? • ' B8 

. • m- ■ : ■■■■■ . : . .. ■ . 



4 . ■ - : - ■■ ' ■■' ' • ••' • ■ k- - ■ - ■. * 

I Cost and Output i Combining the cost information witlr~data 

^X^oh' the output of the systek, the ef fect of changes ~in €he 

■■- ■ • : - - ■• ' • 1 ' 

level of apejbation, can be illustrated. In this simplified 

v . .-. ■ qr-i . • 

approach, we shall assume that the various types of broad- 

i ■ • ' 

cast services ^have the same -unit costs and that all costs 
were related to the production of the broadcast hours. 



As shown in Exhibitf 3, the average costs incurred 

• ■ , * ; v -.. . 

per hour of broadcasting time in the st^'rtr-up 



ERLC 



peripd r are very high. This ^ Is because ^f the 

/ . . ■ . ' . " 

lov? level; , of output and the inclusion "of .all equipment costs 

in this '-'-phase.. Average costs dropped dramatically in the 

. * . .... .... . • « • ■ 

trial operation phase as output increased more than ten-fold 
ah # d exp^ditures Iricltitfed *no fixed costs. As the project 
moved- to^.tnW demonstration- phase, the numbeP ; o£*:1>rbadcast hours 

' -^W:^ 7*''V \* ''' '-.-W. * ■ ■ /•••-. ■ ' 

took another cpa^tum leap. - Again, only variable costs w$re * ; 
ineurreaMnd average ::; ^s t s^£0ii tinued to declifte to $22/hdur r ." 



If the present configuration <and bro^cast #chedufe (40 hc^ 
week) remained constant~.over the next year, average costs - 
incurred per broadcast hour would- decline oni^^light^Ly "if 



at all. 



The column on the far. right in Exhibit 3 presents:; the 

. . "',-«■•■• y ■ ■ ■• ' -.*..■ 

estimated average true costs for the output in each phases 
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Project SCS .Output an^ Total 
and Average Cost by. Phase "- 



Phase 



to 

0 



' Start-up 



Trial 
Operation 



' i 
Demonstra- 

tion • 



Output 

Broadcast 

Hours 



21 



* 237 




Total 
Incurred , 
Costs 



Incurred 
Averse 
Cost ^ ^ 



34,650 



51,650 




88 



er|c 



Estimated 
True Cost 
Total 



Estimated 
Average 
True Cost 




1,791 



8j$5b %x - $ 37 12,097 



51 



25,403 



.33 ' 



> 3 



When the hidden labor and space costs are taken into 
account, the effect is quite noticeable. Estimated true 
average costs in the demonstration phase, the phase most 
closely approximating costs for £ull scale qperation, ate * 
50 percent higher than the costs ^actually incurred by the 
project. The declining average, "costs , either for estimated 
true costs or' for costs actpaMy" incurred, indicate the 

presence of scale economies ^IS^&iTting- from increased 

■ ' " ■■ ' „ ' 5**. ■ ' ' // : 

broadcast hours . 

1 * 
■f ' °« •■■..■> . ; ' 

\ ? 

Technological Considerations : Irv examining the services 
CenTeX is providing through Project SCS, two .basic issues 
arise concerning the, choice* of technology : Are^there 
Substitute means of providing similar services that are 
more cost effective? "and (2) Are project costs sensitive 
to changes in the configuration of the system CenTeX has / 



i^^^^^ed? . .- % ; ,,,,, 



The project of fers audio and teletype infor- 



mation services including 'local and national news, sports, 
books, interview programs , and religious programs. The * 
, largest portion pf the services are provided in ; 

the audio mode (37.5 hours per week for audio broadcast 
compared to 2.5 hours . per week for teletype services). 



: Bll 
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At first glance, it might appear that the variety of 
regular radio broadcasts Would satisfy the needs of the 
print-hahdicapped. But according to SCS projecJt staff, ; the 
information provided is significantly different from 
that broadcast by regularly, licensed radio stations 



in the area. For example, the broadcasts announce 
meetings and events important to' the handicapped community. 

The; news is a major component of the SCS broadcast. Localyjj 

■ < JM 



stations' provide only 15 minute summaries while SCS provi 
%as much as two hours of news. Thus, in the project area", i 
appears^jto provide alternative information services not 
Already available to the print -handicapped. *This may be 
'^0TO3^ct"jeriSlt:ic of smaller coxnmunities. In larger metropoli 
tan are^s , however , there are all-news radio stations/ hq.ur 
of religious programming and interview shows. In these 
areas, existing programming may directly substitute for aud 
services such as those provided by the SCS- project. Also, 
Nat^bnail Public Radio provides a significant amount of pro- 
^^grairanlJng for^fclte blind, a lthdii|rh^ this service'is not curren 
: av^ J-able in the project area. m * 

It is instructive to ^ compare the costs of a newsletter 
a more conventional means of disseminating printed materia 
with SCS costs of teletype service. A weekly newsletter is 
not a direct substitute for the current SCS bro< 
because SCS services are daily, providing current 




announcements important to the deaf community. Nevertheless , 
examining the simplified cost comparison provided below 
provides insight into the relative costs of these two 
alternatives for information dissemination . 



As mentioned above, teletype broadcasts are currently 
limited to 2.5 hours per week, or about 30 minutes per day. 
According to SCS projegfc staff, it takes approximately ^four 
to five hours to prepare the programming for each day's ' 

j^TQadCag 'Much of the preparation time involves rewriting 
material* using vocabulary that is more^easily understood by 
deaf persons . Similar preparation time would also be - 
required in developing equivalent information ^^^"^e^s- * 
letter. The important factor, then, is the relative costs 
of disseminating information; that is, how do the costs of 
broadcastifi^ the information (including the teletype service 

y^hare of %hei fixed and operating " copts for the broadca^t^ngv^i 
f acxlxtie^ /and; the costs associated with" the v receiving equip- 

+ men-t') compare to the* costs 61? having the same material print- \ A 
ed and delivered by mail? * 

- ' V V: • , \ . ' . -;<U_. . .. 

Exhibit 4 shotfathe relative c?bsts of printing and 
distributing a veikly newsletter and SCS teletype broadcast 
services "thai: provi^^the" same information. In determining 
these costs, the; following assumptions have been made: ^ 



Exhibit 4 • 

" > '■ : 

Comparison of Information Dissemination Costs i ' . 
for a Newsletter and SCS Teletype! Service'sT T' • •: 



Number of 
Recipients 



Annual Cost 
for Newsletter 



„Cost for Years for News- 

SCS Service. letter Costs to 
* . 4 Equal' SCS Cost 



1 
5 

i 

10 

- 50 
A-> 100 
200 
300 
"400 
500 



$ 
$ 
$ 



12V 
338 



606 

/ 



$ 2,751 

$^3y350>: .• " l< 
$ 6,534 
$ 9,914 
$ 13,194 . S, 
.$ 16,476 



3,906 

4,170 

4,500 

7,\.40 
l0 / -440 
17,040 v v 





2.6 



2.4 



1 1* 



36,840 



2.1 



1000 



$ 22,482 



63,240 



2.8 



2500 . 
50'00 



$ 57,000 
$112'-, 130 



152,340 



10^0,840^ 



2.7 • 

2.1- ■ 



• The weekly newsletter containing the same 
information as current SCS teletype 
services would be 20 typewritten pages in 
length; it would be distributed using non- 
profit organization bulk ma^l rates; and 
printing costs would decline as the volume 
of weekly copies increases according to 
the following schedule: * 

less than 100 copies 5«/page~'^ 
101 to. 500 copies 3«/page 
more than 500 copies • 2<r/page 

*♦ 

For the teletype services, the share of ' 
fixed and operating costs is determined by 
prorating total SCS 'costs (exclusive of 
• labor posts slijcer they y ^i.e assumed tt> be 
t the £ame~ for the- newsletter -and-tele^t^^V*-.^-':'- 

services) in the proportion of teletype 
broadcast hours to total/ broadcast hours. ^ 
This amounts to approximately $3,840 over 
two years. The cost associated with the 
teletype reception is^$66 per terminal. 
A reduction in cos^/of- 5 percent and 10 
percent is assumed "Tor systems operating 
with 500 and 1000 receivers, respectively. 

As shown in the tablf., the cost of^the SCS service 
always exceeds 'the cost) o£L v the newsletter, regardless of 
the size of the fharket for the information. However, it 

z^ts very important to note that^the costs of printing and 
disseminating the new^tetter are! virtually all recurring 
costs while the costs for dissemination by teletype are 
virtually a^ f ^^^ : ^osts . Thus,! after a certain period 

» of time, the iQiimaiafci costs for the< newsletters will 



equal, and the costs of SCS teletype service. 

The column on the far right in Exhibit 4 shows the -number 
'years of operation it would take for the costs of the 



newsletter to .equal the costs of tfi|e^|le|ype service 

undec the assumptions listed above s 

'...•••■•■.*'■■"..'■ . ■ * 

^ .As the number of recipients increases Atom one to. ■ ■ ■ 
r 50, the period required to preach a break even ptoint drops 
very qufckly. However, for a system of 100 recipients, the 
years it would take to break even increase. This a direct 
result of assumed economies in printing costs At* 



production. As the number of recipients increas 
500 , the years to the break even mark decline <fl 

, ... ^ ■•- T • --- ^ ■■ -1 — 

the rate of- decline is-mach slower. Then f or ^ aJ?ffl^1Bam of 1000 





recipients , the number of years (until the ne^^^ft^er costs 

will Bqfi&l SCS. costs) increases again due to further 

economies in printing costs, despite an assumed 10 

percent^ reduction in the costs for SCS receivers. " Finally , 

' ■ ' / 

.^systems operating at a much larger scale , 2,500 to 5 , 000 

^aSecipients , show no discernable reduction in the time it 

' • ■ ' ■ --r; 

"would take for the cumulative newsletter costs to equal the 

^ post of disseminating the information by teletype. It can * 
■ be flftrtheif^observed that a system of 500 recipients of *■ 
information appears, under these assumptions^ tSb*Be the 
level of operation at which the costs of the newsletter 

, will exceed the costs of teletype service in the shortest 

" ..... < ^ v.- ■■ , 

periods of '*im€^Slii estimated 2.1 years. 

n ■ .. ■. . jfiiywr ■/■•./ 

From^this example, the SCS teletype 'service seems to 
/•be reasonably cost compe t i t i va^/i th a frequently used, *k' 



alternative means of information dissemination, the 

newsletter. For a system 1 of modest size, such\as 200 inform 

tion recipients, the costs of SCS services wouloNbe com- 

parable to those of a newsletter in just over two and one-' 

half years (assuming cost sharing with -other SCS services 

•for -costs of. setting up .an^ k ^nagirt^' 4 the studio). However, 

a significantly larger~'s^gtem offers no improvement in the 

relative* costs of these alternative distribution methods. 

* .«•*• 
w.' The second major issue related to technology is the** 1 

sensitivity of project costs to changes in the' conf igu'ra- 
tion of the system that CenTeX his developed. There may y 
be some room for cost reductions through possible modifica- 
tions or substitutions of the particular system components 
CenTeX has selected for its present system, but these would 
provide only minimal reductions.. The technology being' 
used is relatively mature and major innovations in broafd- 
casting techniques are not expected to provide any cost 
"reductions in the near future. ? * 

While technology costs dp not appear to be .easily ! * _.. 
reducible, - the co^t/output ratio may be reduced if SCS is 
successful in its second year objectives. CenTeX intends 
to expand its broadcasting radius by networking" with an 
additional FM station.^This , will greatly . increase the 
potential audience served at- only the cost of redistrihu- 
tion, of the programming (approximately $5,000 for additional 



leases according to SCS project staff) . 



ct staff) . a 

/.-■' . " / : 

Equally important, CenTeX intends to utilize/.multi- 
plexing technology which would allow all tltfree modes of 
information (audio, teletype and braille teletype) to be 
disseminated simultaneously. Currently, only one mode can 
be broadcast at a time , limiting the total hours of service 
-provided to any one population. Successful multiplexing 
will increase the system's technical capacity for information, 
dissemination , but it may also increase the total costs ' 
for preparation of, programming because more programming, 
will be required. 7 

/ * ■ ' '' 

Potential for ffcqnomies of Scale : The section on "Cost and 
Output" briefly described the relationship between the 
volume of broadcast hours and project costs. It is important, 
to remember that as broadcast hours increase from the trial 
operation phase to the demonstration phase, the average cost" 
per broadcast hour declines both in terms of costs incurred 
and estimated true costs. At' the end of the demonstration 
phase, SCS was broadcasting 40 hours per week. Except for 
increases resulting from expected multiplexing of programming, 
it is not likely that the system, will increase its volume of 
.broadcast time. Thus, any further reductions w in average costs 
of broadcasting hours will come from productivity improvements 
and not from increases in the scale of broadcast operations'; 



Economies of scale may also , be examined from the 
perspective of demand for the services offered by CenTeX.V 
More specifically, what is the significance of scale 
economies as the size of the audience increases? 

- In its first year, the SCS project served a population- 
of only 80' persons, as the staff, concentrated on establish- 

■ / '.' " . ' - . 

mg the.programnung and broadcast services. The cost of 
receivers 'related to the project thus far is less than 
$6,000, a ismall portion of the project costs. 

It is important to consider the importance of- the costi of 

receivers as tiie stale of the system increases. At their) 

■ A. • • * •. • . ' ■ ! 

current price , the cost of receivers will equal the cost of : a 

'year of operations for SCS if the scale of the system increases 

to an audience of 1000. Above that level; receiver costs will 

dominate project costs, if information services such as 

,those provided by SCS are to reach a large number of. .persons, • 

then the potential for price reductions in the receiver costs 

becomes an important issue. 1 

The actual reduction in receiver costs with increasing 
scale is unknown. However, according to SCS project staff, 
the manufacturer of the receiver has suggested that 
price reductions can be realized beginning with orders of 
500 receivers. At this scale, the price should decrease 
approximately 5 percent. \ Orders of 1000 to 2500' should 
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yield. a 10 percent reduction in cost* 



f » The question of scale economies may be secondly to market 
barriers which currently aye prohibiting the penetration of SCS 
programming to any great extent. For scale economies to be 
realized, the manufacturer has to be assured of the marJcet 
demand. Either SCS has to place a bulk order for receivers or 
norrtal market signals must be generated to induce production ' 
*by the manufacturer. Because of .copyright laws, the receivers 
must be owned by CenTeX to ensure that the handicapped are the 
sole recipients of the information taken # from newspapers and 
magazines. Thus, the receivers cannot be sold on* the open 
market, and no ^normal market signals can b6 generated so that 
the manufacturer can determine the demand., , CenTeX must provide 
the nfianufacturer with a large order for any cost reductions to 
be realized which will require an ^extremely well organized and 
•intensive marketing effort. This obstacle will act as a 
deterrent- to the expansion of the JSCS audience and to the " 
reduction in the price of receivers. It is likely that receivers 
will continue to be specially built upon redeipt of individual 
orders. 1 • , 
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1.2 TALINETV 

University of Denver 

Graduate School of Librarianship 




TALINET is a consortium of.' libraries^ using telecoirt- 
munications for educational and information services. v 
The demonstration focuses on comparing the utility of slow- 
scan TV and two types of .telefacsimile equipment (Qwip and 
Rapifax) for improved information resource sharing among 
libraries in different locations . Five remote libraries 
'(Durango, CO; Casper , WY; Dodge City, KS; Billings, MT; 
arid Rapid City, SD) are linked with thfe University of 
Denver Library School, the National Oceanic and Atmospheric 
Administration (NOAA) , and twelve members of the Federal 
Library Network Prototype Project (FLNPP) .- Principal ' 
activities of TALINET have been the sharing of 'library 
resources and' the provision of information services. g 
Community analysis , training, and evaluatioij programs are 
also part of the demonstration program! 



Pyoject Costs ; The costs of TALInET for its first 14 months 
of operation were .supplied to us by the Project Director. 
These costs cover the first three phases and are summarized " 
in Exhibit 5. The project had not yet developed to the 
institutionalization stage. 
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Time 
Periods 



... -Exhibit 5 " . ■: , • r, ' V 

TALipT Cost summary ■ ''. • v; [ ■. h . * 

■ . ■ , •'• ■ ■■ '■ . *' " 
. " 1 - • ' t' 

Installation^ Tri^l . Dempnstra&n ; Institution- 



and start-up V. 



Zost 
Categories 



alizatiori 

from 1/15/78 ;' from ft/ll/78 ' • from 12/2,0/78 from 3/15/79 ' Total 
to p77|ito to 3/15/79 to 171577? ■ 



1. Equipment 

(purchased or leased) 



$10,080.00 . $24,120,00' : ffe-, 900, 00 



2 . ' Communications and 
computer services , 
L i (purchased or leased)" 



1,852.00 2,027.00' 



to 
to 



3. Space provided through 
.'overhead 800x 
$5.00'= $4,000 " 



2,664.00 , 1,332.00 




V 



4. iabor (administrative., ) 25,225.00 
"operating) ; ,7 , ■ 

r ■ 



iOi 



6. Miscellaneous - Travel 4,275.00 

."' ; ' - NOAA . ' 5,000.00 

'■' - Tuition . 4,018.00 

... ' - Other 6,303.00 



8,27l,;00 
15,000.00 
5,563.00 
7,008.00 



ERLC 



TOTAL COSTS ' 



1,771.00 



1,332.00 




■11,904.00. ' 11,796.00 



5. Programming/software Q . 2,470.00 5,120.00 2,138.00 



l r 445.00 
6,000.00 
6,091.00 
2 , 54 0.00 



$61,777.00 • $80,345.00 • ' ; $43,013100 



'■$ 44,820 



5,650 ' 



; 5,328 



48,925 



■ v 5 



;9,728' 

in* 



71)514. 



'$185,135 



• 7 As 'Exhibit- 5 shows, the costs for the project vary 

• considerably in each phase.' Costs/ for the nine-month 
installation and start-up phase were ;$6 1/777 ', or 34 percent 
.'of the total '-costs. Despite the fact that 'the trial opera- 
tion phase was only three months long, the *costs of that 
phase were 43 percent of the tdtal* or $80>3'45. The costs 

• ' i-- ... * : . . • ',. ... • 

for the demonstration phase, which was also three months 
long, dropped to $43,013, or 1 23 percent of tjoijal coat* ' ' 

. Fixed, .costs were approximately 32 percent of the pror \ 
jec-tL* costs , with variable costs accounting for the remaining 
68 ..percent. Equipment accounted for 24 percent of the total 
costs r and labor odsts amounted .to 26 percent of the total. 
Interestingly . /miscellaneous ,'costs^ were the highest of any j 
co'st category, neariy 40 percent of all costs. ■ * 5 >' ' 

A closer look at costs project phase and cost date-' | 
gory provides some explanation of these expenditure patterns 
First, the relatively high total outlays in /the. trial 4pera^ 
tion phase are due largely to* expenses, associated with ^he ' 

v lease of slow-scan .vid^o equipment. The slow^scan .equipment 

> L " > ■ /.V ■ - :; .V- : 1 <T" ^ ; v ' 

was removed for much of the demons tr&tion. 0hase'Y,-and th£ 

equipment costs dropped dramatical ly. it is also interesting 

to note that equipment, costs were not incurred entirely in. 

the installation phase. Fixed costs fbr ; project $ sudh as this 

are riot necessarily incurred, eai^Ly, in the projecftiv u 



f * 
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I ■ ' xt is also! import ant, to note, that "labor costs remained 

'•/. •. **.'"• •', . ■ . . - 

.. / relatively constant in the tria).' operation and demons tratior 
*>phaMS, despite a 50 percent drop, in output between the .two 
/ phases, (outputs are, discussed in more Retail below) . 

' The implication is^that labor costs are not sensitive , 

' -V->" - *«'V . < . : \< Sr • - .' : . - 

t,o decreases; in demand. Particularly*' \n . TALINET 1 s- institu- 

\ tibhal^ con text, .(i.!^, university and government^, it is 
difficult to adjust, labor inputs downward to mk^t declining, 
.demand* for services, phi's says 'nothing, however, about the 
relationship between lallor reijiairein^rit's and output as demand 
. increases., ^ - v . r 

» - Finally* the ^arge share. that miscellaneous costs 

; •' - " v-> '. ; - . : \r . - : ' • •• - 

accpunt for is an important characteristic^ of TALINET as 

a demonstration; A large v portion of these costs would not • 

/ * , ■ v. ?v. - • 

occur in an* institutionalized system. In particular, 
expense? for travel ar^ attributable to* training, interview- 
- ingT> . and .evaluation activities conducted* as part of the 
demohstration . Second; miscellaneaus costs .associated with 
NOAA were 'incurred as part, of an agreement between TALINET 
A and NOAA. ^AJiINET agreed to assist in, paying for equipment 
costs for the FLNPP' in exchange-f or trainings library 

t .« ■ r 

resources, and a telecoimnuijic^tions technician; Third, tui- 
tion payments were incurred as part of the educational com- 
ponent^ of the demonstration. Thus, in an insti^utipnalized 
system/ tniscellaneous costs would likely be only those 



shown as "Other"- in Exhibit 5.; . . 

Additional Costs : Demonstration projects often are 
fortunate in that they attract devotees* who provide 
individual and institutional* support. During the 14 
month period from installation and start-up through the - 

demonstration period, TALINET received services in the 

\ . • ■ • ' s ; - ' ' • 

form of supporting labor and training from NOAA and the 

five, remote libraries. Similarly, NOAA, the remote 

libraries, and the Library School each provided space to 

the TALINET system. These contributions of labor and ' 

Y * '■■ \ . 

space are itemized iri Exhibit 6 j 

Some/ of; these apparently "donated" resources were 

•r V ' 

paid for, indirectly, through the/ agreement with NOAA 
mentioned in the previous section. Payments to NOAA by 
TALINET totalled $26,000. The estimated value of the 
labor and space provided by NOAA is only $13,220. In 
addition to this, however, is the value obtained- by the 
TALINET system in being able to work at the NOAA library 
and use ( NOAA resources to fill information requests from 
the remote libraries.* These resources are assumed to 
have a "rental" value equivalent to the difference between 
the payments made to NOAA by TALINET and the estimated 
value of the labor and space provided by NOAA. This 
amounts- to $12,780." 



Exhibit 



TALINET 



Additional Labor and/ Space Costs 



Input 



Volume • 
of Input 



Estimated 
Value 1 



Labor- 



NOAA-GRA Staff Training 
NOAA Machine Operator' 
Five Site. Xibraries 

. Total 



Hours 

320 
1440 
7200 

8960 



Dollars 
Vl,92Q 
.8,300 
27,692 

37,912 



Sp"ace 2 
NOAA 

Five Site Libraries 
Library School 

Total • 



Sg. Ft. 
400 
500 
200 

1100 



Dollars 
* 3,000 
1,000 
1,000 

5,000 



i 



Estimates of value calculated from wage and salary data 
provided by. the project director: 

' NOAA-GRA Staff Training $6.00/hr. or $12,480'per year 
NOAA Machine' Operator' $5.77/hr. or $12,000 per year 
Five Site Libraries ' $3.85/hr. or $ 8,000 per year 

•Estimates of value calculated from rental rates provided 
by project director: ' ~~ 

NOAA $7.50 per sq. ft. per year 

Five Site Libraries $2.00 per sq. ft. per year 
Library Sehool $5. 00* per sq. ft. per year 
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.Additional labor and space used, but not paid for, 
. .1 

has an estimated value of $29,692. When these additional 
costs. are considered, basic cost characteristics of the 
TALINET system change somewhat. True labor costs are 57 
percent higher than those actually incurred and space costs 
are 38 percent higher. This has the effect of slightly de- 
creasing the ratio of total fixed costs to ^ariabie "costs; 
however, the proportion of labor requirements to require- 
ments for equipment, changes drastically. .Where inputs of 
labor and equipment" were approximately equal for costs 
actually incurred during the. demonstration (when the true 
costs for the demonstration are considered) the cost of 
labor is nearly twice that of equipment. Furthermore , when 
the costs of the final configuration of the communications 
system are considered (see section on "Technological Consid- 
erations") , the labor inputs exceed equipment requirements 
even more, ' 

Cost and Output : The cos£ of information can be combined 
with the data. on outputs in an effort" to determine how 
the levels of total costs and average costs respond to 
changes in the level of operations. .In doing so, it is 
assumed that all costs were directly related to the trans- 
action fulfillment part of the project. In addition, the 
two types of transactions, information and administrative, 

are aggregated to develop a singl©' measure of system output. 

'. / ° < " • 
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The output levels and total and average coasts for both, ' _. 
incurred and estimated "true" costs are shown ^in ^ 
Exhibit 7^ _ 

♦* t 

It would appear from these data thafr-the average cost 
per transaction increased slightly. , from the total operation 
- .fchase to" the demonstration phase, ThiS^ficcurred even though 
the level of system output fell from 7^4 transactions to 
84. ' 



|* For this ^particular demonstration , examining average- 
costs using the format we have chosen can yield some' mis- 
leading results-. I.t cannot be concluded that as TALINET ■ 1> ^ 



a 



proaches a fully operational phase , the average cost per 
transaction will remain high. As mentioned above, the 
/ first year of the project included testjing three systems. 
Thus, the average costs, as shown in -Exhibit 7, -reflect the 
costs of these three systems. An oper^^onal system would 
use only one technology. ** "• 

>-£ ■ 
p 

Technological Considerations: In some ways, the costs of 
the, TALINET system are dependent on the choices made "about 
the specific technologies to he used. These choices are 
the driving forces behind the equipment and communications 
costs during the three periods. These costs are itemized 
V in Exhibit 8. 
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V> : ^>"^ : ffi'"V^:''lV: " TALINET A -.P V'-V '• '': 

Output and Total and Average Cost Sy Phase 



OUTPUT 



PHASE 



Information 
Transactions 



Administrative Total 
Transactions • Transactions 



Trial Operation 
Demonstration ' 



674 
284 



120 
100 



794 

ioq; 



PHASE 



INCURRED COSTS 
Total Average 



ESTIMATED "TRUE" COSTS 
Total Average-, 



Trial Operation $80,345 



Demonstration 



$43,013 



$101 



$112 



$90,241 1 $114 
$52,909 $138 
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• . Exhibit 8 ,.. ^ *• 

Equipment and Communications Cost Detail 

I./ ■'■ -Equipment y-^;^- /.< Cost 

QWIP telefex (§.40/month x 6 sites x 8 months) $ 1,920 

RAPIFAX telefax ($300/month x 6 sites x 7 months) ,'; $12,600 

Slow Scan TV > ( $ 9 6 0/mon th x 6 sites x 5 months) $28 ,800 

" *. J • Total $43,320 

CommuiuGations' ..... . 4 V c6st / 



9 
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Telephone Service and Long Distance $ 5>850 



GRAND TOTAL $48 ,970 



It is' obvious from the table th&t the dhoic&s made 

regarding the specific technology to be yUsed and the metho 

~ ■ . . .. . ' ' / 

of communications play an important role in the determina- 
tion of the costs. For example./ the /slow-scan TV 'system ^ 

represents 66 percent of the equipment costs . During the 

. ' . ' . ■ " ■ • '"' " /• • ' . .. ' "• • ■ • " 

course of the trial operation pha^e , the project staff 



determined that the slow-scan equipment prpvided no advan- 



7 

tages over the facsimile equipment ,.. or at least none that 



WQuld justify the cost. As a /result , the slow-scan equip- 
ment was eliminated from the TALINET system. 



Had s low- scan* TV riot been part of the experimentation of 



this ^ro^ect/ equipment costs would ^ave iambuwted to only 
$14 , 520 •• This clearly shows the ef f let "substitution of 
technology has on costs. In an operational system/ the 
cost would be even further reduced/ because only one teler 
f acsimi le system would be used; Thus ,, the aggregate :: ■ 
technology costs incurred during this demonstration project 
do not provide aft accur^e^iriidication of the ^ costs likely >,• 
to be incurred by an operational system, V- 

An important aspect of the TALINET demonstration is the 

- examination of alternative telecommunications technologies 
for library resource sharing. Using supplementary data and 
analyses provided by the TALINET project staff , a cost com- 
parison of the two telefacsimile systems used/ Qwip and 

.Rapifax, is presented below, 

. . ',* ■ , . ■ ■ \ 

The t;wo facsimile systems provide five different V 
.modes for transmitting information. These modes and the 
unit costs incurred for document delivery (including only 
the technology costs) are presented in Exhibit 9, These 
costs are based on average document length and the average 

- monthly volume of transactions TALINET experienced during 
its first year of operation. Documents averaged- six plages 
each, and an average of • 137 transactions were completed 
eachJ^brith. 
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As can be seen from Exhibit 9 # at this voli^tae 
of transactions .. the Rapif ax system operating in the 
high spe6d mode is the least expensive. The reason 
Rapif ax performs more efficiently; than Qwip is that the 
variable costs of telephone lines are much lower for 
'Rapifax, given that TALINET must Use long distance 
lines. For Qwip in the six-minute mode , the cost per 
six-page document for. the telephone line is $20.97 as 
compared to $2 .47 for Rapi fax ( Hi gh Speed ) transmission 
to the same location. However, the use of leased lines; 
given sufficient demand for the service, would the 
cost of communications a f±x6d cost. . ^ 



Exhibit 9 



TAtlNET 



Unit Costs for Telefacsimile Document Delivery 



Telefacsimile System — Mode - Cost/Transactions 

Qwip 4-minute mode $17.81 

Qwip 6-minute mode $22.72 

Rapi fax (High Speed) $14.73 

..Rapi fax (Standard Speed) $16.25 . 

Rapi fax (Fine Detail) $17*.77 




Based on an average of 137 
transactions per month, and 
6 pages per transaction . 



/. The TALINET staff also provided their estimates of 

o 1 • ' , . ■ ■ ■ • ♦ 

they break even volume and tin it costs per transactions for 
th$ Qwip*1200 versus the Rapifax 10,0 equipment. These ; 
are 1 presented in Exhibit 10. Once again; these esti- ' 
mates include only the costs of technology utilization.- . 
Below the break even volume, shown in Exhibit 10 ', Qwip 
will be .less expensive/ and above, the' break even volume, 
Rapifax will be less expensive. At' the unit cost shown • 

*."■■■■.- * '■■•■». ■ ... .. 

• • • •' •' • • ' • • - , ■'; ' ■ • •* ■ . '-'«'■*• ■ 

in the Exhibit > the systems are comparable from a cost 
standpoint.. ' - . /-.'.> . ' • 



As these data show, the TALJNET project found Rapifax 
facsimile to be the most effective of the three technologies r 
used in the demonstration; But there remains the. question 
of how cost co^ipe-ti'tive telecommunications systems are with" 
alternative document delivery methods. In particular/ is- ' 
the Express Mail Service of the U.S. Post Office (24-hour 
delivery) competitive with Rapifax? Once again , data were 
provided by TALINET. 

ft , '•' • 

The highest Express Mail rate to any of the sites for ; * 
•'. a six-page document is $7 . 55 . Note that this • is approxi- ' 
. raately one-hair of the $14 .77 per " transaction^ that TALINET ' 

experienced on, the average during the course of the project. 
* Exhibit, 11 shotos the number of transactions required per 
month for Rapifax to compete on a cost basis with Express 
Mail Service. It is apparent from the Exhibit that the average 



ERIC 



Monthly Breakeven 

, rer o^agrTransacFibn for , 
QWIP 1200 and RAPIFAX 100 Telefacsimile Systems . 



Hi Speed 



Standard 



' Rapifax 
•• Pine Detail 



'■■; J X 



'Unit 



Unit; 



Transactions Cost Transactions Cost Transactions Cost 



1WIP 4-roinute mode 



104 $18.32 



K 

$17.99 



137 



$17.77 



)WIP 6-minute mode 



78 



$24.01 ' 85 $23.75 



94, • $23,38 



114 



9 

ERIC 



monthly volume of transactions made by TALINET (137 per 
• month) does . not yet make it cost competitive with Express 
Mail- Service where . it exists (no service exists to burangp 
and Dodge City . ) $7. 55 per transaction there would' 

have to be 207 transactibns per month for telefacsimile 

, • .'•■''«.' 
✓ to be cost competitive- Moreover, since Express Mail offers 

. ' •• ■ .• .; ■ .. " .'•'■••;.*'.." . *i 

24-hour delivery directly to the client, -instead of the 

library, as 'in the case of TALINET, the time-saving advan- 

tages of telefacsimile for this type of document 'delivery 

are also limited. 

t m ... „*..„... . 

V -. . ; , . + ' . ■ ' 

~~ — . ■. v t- — . - - 

Exhibit 11 . 

TALINET . 



Morithly B reakeven Volume Per Six-Page Transact-. inn ' 
Kapirax vs. axpress MaiTl — ~ ~~ — "~ 




Rapifax Rapifax^^ Rapifax 

High Speed Standard "^ Fine Detail 

Express _ • • • 

Mail • 207 270 r 340 



A final point to be made concerns how the cost of 
technology can be expected to grow with increased utiliza- 
tion. .From a technological standpoint - the system is not 
being fully utilized at the present volume of 'transactions; 
a much greater, volume can be transmitted for the same fixed 
cost of equipment. Although this is not necessarily true 



s 



s 



for communications costs, we need not conclude that tele- . 

• • .... , ' < : « v, 

phone costs will grow proportionately, with the number of 
transactions. Increased usage may make it mjjre economic . 
to use leased lines, WATS, or similar services. Also, 
documents, are currently being transmitted during the daytime 
when long distance telephone rates are highest. Use of .off-, 
peak hours , made possible by machine-to-machine capability V: 
can also yield" reduced costs. T^Ls delivery 
eliminate the need, for a separate telephone 



mode might also 
for telefacsimile 



assuming usage is not sufficient to justify ; leased lines. 



Potential for Sqonomies of Scale : . As discussed above there 
are cost advantages for increasing the utilization of the 
technology. The marginal technology cost (for telefacsimile) 
pf each additional transaction beyond the initial one. is the 
cost of the telephone line where lease lines are not ullid. 
This ig true up €o the point where the machine is being used 
100 percent of the time. When the volume of transactions is 
sufficient to justify leased lines, all technology costs are 
fixed 9 and the marginal technology cost is zero. Thus/ 
average costs are declining as the fixed cost is distributed 
among the transactions , and , in either ease, cdst advantages 
accrue by increasing the sc&le of output. 

In contrast , the potential for declining average labor 
costs, as the number of transactions increases , is quite 
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limited. The type of information services offered by the 
TALINET system are very labor intensive. Total, processing 
time for requests averaged 14 to 16 days, with delivery time 
to the remote library accounting for less than' one day> 
TALINET offers three kinds 1 of research services: literature / 
searches, responses to reference questions, and interlibrary . 

loans. Although the cost of labor varies for each kind of 

* ;• ' •' • ; ■ " • • . • 

service, each information request must be researched by at 

' . .• .'. / ■ I ; 

least one member of the- research staff. There lare no. short 

cuts and few opportunities to substitute technology for 



labor in, completing the research tasks. 

* ' ' ' . \ ■ 

■ . . * -■ ■ ' ■ V ■ 'V- ■' 

As researctt staff members become more sKiiled^ at filling- 
information requests/ the project director has observed a ^ 
modest reduction in the amount* of time needed per request. 
Moreover, these increase^ in productivity are reached rathe^ 
quickly as research staff become familiar with the types of 
requests that are made. At the same time, the project 
director has' observed that users of TALINET. have also grown 
more. sophisticated in the types of questions they ask. Thus, 
the marginal labor cost^ of .completing information trans- 
actions are likely to remain relatively constant. 

,' t *. • . . ■ ■ ■ 

Although we do not have enough information to know 
precisely the relationship between costs and service levels , 
we pan expect that average total cost per transaction (as 
opposed average cost for equipment or labor only) will ■ 



decline slowly, 'owing to- the economies that can be reached 
through increased use o# telecommunications. However, since 

e % 

labor costs will dominate as system utilization increases, 
the potential for achieving significant economies of scale 
is expected to be limited. • V 



1 .'3 DEAF COMMUNITY CENTER 

Computer-Assisted Telecommunications for the Deaf 

v • ' ' ' 

The Deaf Community 0 Center TDCC) of the ♦Roman Catholic 2 

Archdiocese of Boston is demonstrating the usefuin^s of an 

electronic message system for the deaf . The" systtyb. allows 

deaf and hearing participants to store, forward and y \ 9 

reprieve messages and to access special information services 

through a computer. Currently/ deaf persons must rely on 

the- teletype as a substitute for the telephone. To use 

the telephone, both parties must simultaneously be 

connected. The computer-assisted telecpmmunications of an 

electronic message service can provide this "synchronous" 

communication , but it also offers a number of other advantages 

• All messages can be centrally stored so that 
the person receiving the message does not 
have to be on the network when the message 
is sent, i .e.,' communication can be 
t "asychronous" . \ 

-/ • A message can be sent to one or ai£y number of x 
persons on the network simultaneously. * 



B38 

1 . . 



118 



•f \ 

4 • Any individual can access a variety, of infor- 
mation earvicss at any time, such, as oft-li'na 
— i new*, weather, sports, special announcement! 
for the deaf community, or program* on health, 
consumer affairs, eta. 



e Given the impending ubiquity oft remote\ compu- 
ter terminals, aomputer-aseisted telecommuni- 
cation dffers the potential for greatly ^in- 
creased interaction with the leasing community, 
(Teletype conununication oecure almost exclu- 
sively among deaf persons and has an isolating 
effect.) * 1 



Thus, electronic message services are. much more versatile 
than the teletype and are particularly useful for members 
of the deaf community who cannot use the telephone.' \ 

In its f^irst year, the DCC focused primarily on the 
.■ ■*■ •' ' \% 

question of whether deaf persons would actually use computer 

•terminals to communicate, using computer terminals being \ 

.somewhat more complicated than using a teletype. DCC has 

successfully implemented a demonstration network that 

includes 34 families, five public providers of information, 

* ' » 

four agencies serving the deaf, five schools for the deaf, 
and two deaf clubs. Users have been trained on the system, 
and they now use it regularly to obtain and exchange, 
information. 

Project Costs ; The first year costs for the DCC project, 
as provided by the project staff, are presented in Exhibit 
12. The costs shown cover the installation and start-up, trial 
operation, and demonstration phases. The project was not 
Institutionalized in its first year. 
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Aa can bo aaan from tho Exhibit; tha threa-iionth 
installation and start-up phaaa waa tha moat costly, totalling 
$72,900, or 53 percent, of tha firat year eoateV Although 
the trial operation phaaa waa alao three montha long, ita 
costa totalled only $23,336 or 17 percent of the total. 
Finally, the demonatration phaaa, which laated the remaining 
' six months of the first year, required expenditures amounting 
to $42,059, or 30 percent of the total coats. 

When differences in the lengths of the project phases 

■ i 

are taken into account, a distinct downward trend in costs 

comes visible. Average monthly costs in the installation 
phase, were $24,300. Costs declined considerably in the 
trial operation phase to $7,780 per month. Monthly costs 
continued to decline through the demonstration phase. 
In that phase, posts per month averaged $7,010. 5 

Costs may also be viewed by- type of expenditure. 
As Exhibit 12 shows, equipment was the most cos»tly item in 
the project's first year, accounting for $50,223, or 36 >> 
percent of the total./ The second most costly category was . 
communications and computer services, which amounted to 
$37,422, or 27 percent of total costs. Labor charged to 
the project accounted for 23 percent of the costs, or 
$31,474. It should be noted, however, that labor costs for 
operating and maintaining the computer system are included 
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Exhibit u 



Cost Sununarv 
Deaf lSSmunlty Center 
CpJEuter'jyy^ for the DeaJ 



Time 

Cost Period! 
Categories 



intonation 'Trial initiation- 

J^JSS^ ■•5 IIiU ?i ' D«nonitration aliwtion Total 
><3 months) (3 months) (6 months) 





l f Equipment 

i' 
1 .# 

i 


50,223 

> 


/ 




■ in 




2. Communications and 
computer service 


! 9,434 


10,296 


17,692 


mmm 


37,422 


3. Space ' * 

tt * 


900 

* 


900 


1,800 


mmm 


3,600 


4. Labor 


7,202 . 


7,906 


16.366 
/ 




31,474 


•5. Programming/ 
software 


% 


* 

4 

' 


534 


1 ( 

W a H 


534 


6. Miscellaneous 


5,141 


4,234 


5,667 , 




15,042 

1 


TOTAL 


72,900 

3 ■ 


23,336 


42,059 

/ 




138,295 



•Some programing and software costs could not be disaggregated from computer services, 
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in computer services because these services were, leased. 
Miscellaneous costs were approximately; 11 percent of 
total costs / and space requirements accotihted ;f 6r less.;'';.;,::;' 
than three pe^ .: JFiri^lly , programing * 

costs were less than one percent of the ; total. j This is 
also somewhat mislead software 
costs are also included Yin expenditures for computer 
services . vv' : "/' ' ;s; - V 

Several other observations about project costs are 
worth noting , y First y all of • the equipment costis were 
incurred in &e s tart -up phase . This was a direct 
result of the project staff Is decisioji v to purchase 
rather than lease £he equipment. It also explains n : 
wh^ costs were so high fot the a initial phase . Equipment • 
costs represent 69 peijpent of cpsts incurred during 
the start-up phase. As discussed above, average monthly 
costs declined through the ^ three phases. The dramatic 
decline between^ the start-up and trial operation phases 
is attributable almos^ entirely to equipment costs. 
The le^s visible ,\ but still significant, decline in 
average monthly costs* between the latter two phases G > 
is partly the 'result of reductions in computer service 
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costs. Computer service! costs declined from $3 # 432 per 
. month in the trial operation.' phase to $2 , 948 per month in the 
demonstration phase. As explained below in the section on 
M Technological Considerations"/ th^ r decrease resulted from : 
experimentation with leasing less Computer capacity for the 
network. Finally, it is interesting to note that* average — 



monthly labor costs remained relatively constant throughout 
the first year. The 4-ntensity of labor requirements^' 
did not vary greatly even -though use patterns changed in each 
: . of the phases • 

Additional Costs: There are several areas where costs 
incurred by DCC do not reflect the full value of the resources 

«.'- -.' • . V ■■ • ■ 

used. Because the project director is a member of the clergy, 
his salary does not reflect the salary that the director 1 s 
position would normally receive* For the first year/ the DCC 
project director was paid $2,500. A director of* a project of 
this level of sophistication would normally earn, a salary of 
at least $20,000. Secondly, according to the project 
staff, there was some instruction provided to users by DCC 
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insl^uctbrs that wis hot: dire ctltf charged to the proj ect . 
Rather , it was donated through the enthusiasm of the parti- 
cipants in t^e exper 

amount of tiiiie volimte are available , the coikts of this 
labor wdteld not signific^tly increasie project costs. For . 
exanip^ donated ry^r^ii: 

.tJ^at actually paid project costs would increase only 

$1, 25<> for, €he year . According to the p refe ct director r it 
is unlikely that the donated time exceedeePttiat amount . 



"I 

: : ft? 



Thirds some equipment was donated for use in the project. ^ 
Eight Model 33 teleprinters were provided by Bolt , Beranek and 
Newman , Inc. (BBN) / the compauiy providing computer services 3 
DCC , at no cos t to the project. According to the project. 
' director , these units have an estimated value of $600 each, or ; 5 
$4,800 in total. • i- ' ■ "'• 

Oyerall then, approximately $23,550 ($17,500 for the 
direc-fcbr, $1,250 for training, and $4,800 for donated equipment) - 
in additional cost may be attributable to the project How- ; •• 
ever , it should alsw be noxed that no telephone communications . 
costs are charged to the project either » Communications costs 
were incurred by the users since they generally already had i 
telephone service for other reasons. 

When these additional costs are added to the costs shown in 
Exhibit 12, y the basic cost characteristics of the demons tratipi 



changie. ^ Total project costs for the first year amount to 
$161 , 845 , an increase of 17 percent. Labor costs total 
$50,224 , and as a percent of total cost, increase from 
23 percent to 31 percent. Equipment costs total $55,023. 
However, as a percent of total cost for the first year, 
equipment declines very slightly from 36 percent to 34 percent^ 

••• "' ■ • ' ' . :' ... . •*'*•■ . < ' ' 

• .. •• ..- ', ■ ■■• • ■ . r •••*.•'•.••;•.•...;.•*••••. ■•. • . •'• ' . . . • •.. • ; . • ■ •' ;' 

Cost an d Output; Based on data provlH^H by DCC, the , 
average cost per message for the network was calculated for 
each project phase. Average costs are shown by phase in 

Exhibit 13 along with data on total usage and total costs! 
The DCC usage data are estimates based on average use for 
selected periods of each phase. _!/ Additional costs 
discussed in the previous section could not be disaggregated 
by phase so that estimates of total and average true costs 
are not presented in Exhibit 13. 

During the start-up phase, an estimated total of 5758 
messages were exchanged . . That volume increased to 9 ,100 
messages in the trial operation phase, and to 18,186 messages 
in the demonstration phase. s 



-1/ Also, because the time periods applied to usage, data 
provided by DCC did not completely correspond to the 
periods DCC used to present cost data; additional 

, adjustments were made in the usage data so that direct 
comparisons could be made. ; The adjustments affected 
only the estimate for the demonstration phase. 
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. ; M COM ; v. T^: 

Computer-assisted Telecommunications for the Deaf ; ' v :,' : v y!K 
Output and Total and Average Cost ; 



Estimated Estimated 
Total 



♦Estimates by phase could not be made from available data, 



Project Output Total Incurred Averse : True ; True 

Phase ,, No. of Messages Costs Incurred Costs Cost ■ .Cost 



and start-up , 5758 ' 72,900 12.66 > 



Trial Operation 9100 ■ 23,336 . 2.56 



Demonstration 18,186 42,059 2.31 
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With each phase the costs per message dropped. The 
initial high average cost per message of $12.66 is the 
result of the large equipment outlays for the network during 
the start-up phase. In the trial Operation phase average 
costs incurred per message were much less ' ($2.56) . In the 
. demons t ration ptiase average to once again to . -~ 

$2.31 per message, „ a decrease of approximately 10 percent. 

It is also useful to Ibok separa/tely at average 
costs for computer services as the volume of usage 
increased. Average computer costs per message * 
declined from $1.64 in the start-up phase, when usage was 
relatively low, to $0.97 in the demonstration phase when 
usage vjas relatively high . Between tire 

demonstration phases, average costs dropped $0. 16. Note 
that th^ decline in average computer costs accounts for 
nearly two-thirds ,of the $0.25 reduction in average total 
cost per message between these two .phases shown in Exhibit 13 

The declining average costs indicate the presence of 
scale economies in the network; however, for two reasons, the 
data "presented in Exhibits 12 and 13 may %ot provide an 
accurate picture of si z6 of the economics that can be real- 

. ' \ ■ ■' .- •" ' ' '■ ' ' • . ■ ■ ■ ■ ' ■ ' ; • ' - • ■ 

• .*• -' . ■ ■ »■...'■- ' ' s 

ized. First, the computer services are leased at a fixed 
rate so that they ,are not very sensitive to increased 
changes in. the volume of usages./ Secondly,' the project staff 
had £o experiment with the amount of computer capacity the 



.network requires at its' present size. During the demon- 
stration phase, computer capacity (and costs) were halved 
to determine whether the network could function well at 
a lower cost. • System overcrowding resulted and computer 
capacity was later increased. The experimentation resulted 
in reducing: computer reduced the quality ^ 
of service available to users. Nevertheless, the deplining .V 
average costs suggest that there are cost advantages to 
increasing usage of the network. 

Technological/ Considerations ; The DCC project costs out- 
lined; in Exhibit 12 show that technology costs dominated the 
expenditures. Equipment and "computer services costs accounted 
for 63> pet cent of total project costs* It is appropriate then 
as in the/ previous project cost analyses to address two issu^sj 

• /Are there othek technologies (other than 

/computer-based) that can provide similar v \ ■■■"'♦/ 
^ — services more cost-effectively? / 



■/ If there are rib close substitutes for such 
/ computer-based systems, is the system used 
by DCC the most appropriate one? That is , 
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axe project costs sensitive to changes in / 
/ the configuration of the DCC network? / 

In examining the latter issue it is necessary to x separately 
discuss the DCC system as a demonstration and as a possible 
fully operational and institutionalized system. These issues 
are discussed in sequence below. « / 
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There are no effective substitute technologies for the 
type of services offered through the DCC concept. The 
electronic message system, with its asynchronous communi- 
cation , is essentially a new service. I t allows messages 
to be exchanged between one or more persons so rapidly 
that mail cannot compete with it. It allows, but does 
-not require, that the sender and receiver of the message 
be on the system simultaneously so that it substitutes 
for, and enhances, existing teletype service currently 
used by the deaf. These features, in combination with 
additional information services (such as health care, social 
service and consumer information; on-line news, sports and 
weather; or announcements important to the deaf community) , 
make the computer-assisted telecommunications concept an 
extremely powerful means of information dissemination and 
exchange for the hearing impaired. The power of the concept 
lies in the convenient access to a wide variety of inf&rma- 
tion sources that a computer-based system provides. Individ- 
uals and groups can be easily contacted and information 
easily obtained through one device — the remote terminal . 

■* ;'/ : ; , . .. ;.»'. \ ;-. ■' * ■ 

Assuming that there are no close substitutes for 

computer-assisted telecommunications for the deaf, what are 
the technological cost characteristics of the DCC network "and 
how would alternate configurations affect project costs? 



In developing its system, DCC had to acquires 

j« computer terminals for remote access; 

e computer capacity for processing and 
b ";' storage of messaged and information; 

* ■ . ' '" ; .w .' : 

e software for inputting, processing and 
output ting messages ; and 



e communications for dial-up access to t^he 
f computer e 

In constructing its network, DCC was guided' more by 
the need to demonstrate the usefulness of the concept of 
computer-assisted telecommunications than to explore the 
technology cost considerations for a fully operational 
system. Thus, DCC sought to build a workable system at a 
reasonable cost -for demonstration purposes . The costs 
of this system do not necessarily reflect the^ lowest possi 
ble cost for an operational network of this size* 

The demonstration is being conducted using a commer- 
cial time-sharing service provided by Bolt, Beranek and 
Newman , Inc . The software package , HEBMES was already 
available through BBN, but some customizing was necessary 
to meet the needs of deaf users . The remaining equipment 
acquisition included the purchase of 45 teleprinters with 
integrated modems (Teletype Corporation ,- Model 43) for a 
total cost of $49,500* Originally, the terminals were to 
be leased, but when DCC was given the opportunity to pur- 



chase them at the reduced government rate ($1,100, each 
£f B50 ' 



versus $1,600 for commerical purchases) , the purchase of 
terminals became more economic, assuming at least a two- 
year lifetime for the demonstration J Also, six acoustic 
couplers were rebuilt for use with the less sophisticated 
Model 33 teleprinters that were donated to the project. 
Total equipment costs were $50,223. Telephone coromunica- 
tions lines necessary for transmitting data were provided 
at the expense of each of the users. 

There are a variety of computer terminals and commer- 
cial computer services available.- In selecting the appro- 
priate terminals DCC had to balance cost with ease of 
interfacing with computer services, the ability of the 
supplier to meet early delivery schedules and provide main- 
tenance services, and the presence of a monitor light for 

detecting computer carrier frequency. Few vendors could 

r 

provide terminals on short notice and fewer hajd the monitor , 
light that deaf persons need.- DCC also had to choose 
between the use of CRT screens and hard copy printers. 
Hard copy printers w^re chosen because deaf persons are 
accustomed to them from .the TTYs they currently use* How- 
ever, the project director believes that CRTs are much more 
useful for composing and editing messages. They are also 
less expensive and can be purchased for half the cost ($500 
to $600), of the printers currently being used. According to 
the project director , the use of CRT's will be more fully' 
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explored in th« demonstration' a ••cond year. 

DCC alio had to acquire computer services and elec- 
tronic massage eervice" toftwara. The choice of a vendor 
was not baaed on leaat coat criteria. Rather, the services^ 
of BBN were purchased because of that firm'e interest in 
telecommunications for the deaf and their commitment to the 
project. 

4.1 

Costs for using BBN 1 s computer services totalled * 
$34,992 for the first year. Depending on the fee structure, 
computer costs may b4 considered either fixed or variable 

costs. DCC's arrangement with BBN is to pay a fixed) monthly * 

/ H 

fee for guaranteed access to a set portion or number of 
"shares" of BBN's computer capacity. DCC paid $344 per 



share per month. Alternatively, DCC could 



be charged separ- 



ately for its variable consumption of connect time, pro- 

* <j !<»* 

cessing time and utilization of storage capacity The 
leased shares agreement , however , also, provides the. DCC 
network With a "windfall" during off-peak usage* The network 
gains additional computer capacity at no extra cost during 
those periods when the computer is riot fully utilized. This 
is of particular importance • because the 
occurs primarily during off-peak periods 



so that the network receives substantial 



DCC network usage 
for the PBN system, 
windfall. The 



effort of this windfall arrangement is trb provide DCC network 
users with improved service by reducing the response time in 
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interacting wi^h the computer* and, baeauia of the wind- 
fall benefits, it ia Xaaa axpanaiva than being charged 
separately by BBN for connect and procaaaing time. 

» 

DCC haa experimsnted with determining the minimum 
number of shares it neada to provide adequate aervice in 
order to keep computer .coats to a^minimum. . Initially, tan 
/ aharea ware used, providing substantial capacity and wind-. 

4 

fall. (The amount of windfall available to a uaer ia deter- 

* .... a 

mined partly by the number of «heA leased.) Computer coata 
were reduced when the number of JParts wai reduced to five; 
but network crowding occurred* aff the number of computer 
aharea was raiaed to its' curren^level of eight. t 

Thus, while cost considerations were taken into account 
in constructing the DCC network, factors relating to the 
uniqueness of the project as a demonstration also influenced 
the system configuration. The project staff chose hard copy 
printers over less expensive CRTs, assuming that they would 
be more readily accepted by deaf persons. That assumption 
needs to be tested. Also, the selection of a computer ser- 
- vices supplier (including software and hardware) was strongly ' 
influenced by one vendor's expressed interest in telecommuni- 
cations for the deaf. Other electronic message services may 
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have been las • expeneive". In abort, while DCC has 

developed a network that penaita tha damonatration of the 
computer-aeeietad telecommunicatione concept Cor tha deaf , 

t 

tha ooata of such a aystan can ba reduced by substituting 
othar exiating technologies. 

L 

Tha foraging disoussion foousad«only on tha damon- 
atration natwork, which oparatas with about 50 terminals. 
Tha configuration currantly used would not ba cost^af fac- 
tiva in a larger oparational context. For tha purpose • of 
this discussion, a "larger operational context" ia taken 
to mean a network with 400 users using available technology 
Although examining alternative configurations }n detail is 
beyond -the scope of this analysis, several ma}or factors 
distinguiahing the damonatration ay a tern from a potential 
operational ayatem can be pbinted out here* 



e The use of dommercial time-sharing services 
will be more expensive than a dedicated com- 
puter utility* 1 

e An bperational system would have td consider 
the incorporation of the existing, TTY network. 

e The selection of terminals would have to con- 
sider the cost-effectiveness of "dumb" versus 
"intelligent* terminals. 



The use Of commercial time-sharing services currently 



5/ For a more detailed overview of available services, 
see Kas Kalba, et.al:, Electronic Message Systems , 
The Technological , Market and Regulatory Prospects , 
submitted to the Federal Communication Commission, 
(Cambridge: Kalba Bowen Associates, Inc.) 1978. 
As the report shows, it is difficult to compare the 
costs of different systems, because each has a 
unique pricing structure. 
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used by DCC would not be cost-effective in a larger < ' # 
s YStem. A separate larger demonstration sponsored by 
PHEW/BEH concerning compi^r-assisted telecbmmunicatiOns '/ 
for the deaf is currently being conducted, by SRI Interna- 
tional, Inc > A major objective of that p 

duct a -detailed design and cost analysis f or' V lar^fe scale 
system. In planning! their demonstration SRI" examined* the 
relative costs of using commercial- time-sharing services 
versus the outright purchase- of a computer dedicated to 
the network • According to preliminary calculations made 
by SRI in planning its demonstration , a dedicated mini- v 
computer is much more; cost-effective for a network with as 
few as 400 to 500 users than are time-shared services • ' 
For example, assuming a (very low) charge of $1 per connect - 
hour and an average of £ hours per week per user >t total 
connect time cost per year of operation would amount to 
$127,092/ according to SRI • This figure does not include 
processing and storage bosts. *, Similarly, assuming an 
average of 20 seconds of CPU usage per connect hour r SRI con- 
servatively estimates that approximately 14 hours of CPU * 
time would be ponsume^ per week! According to SRI, at typical 
rates for CPU time (e.g,/ $400 per hour) this translates to 
an estimate of over $291,000 ^or time-shared processing costs. 



In comparison, SRI estimates that the same services 
couffd be provided by purchasing a dedicated mini-computer 



)u?^d 
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such as a DEC PDP-11/60, at a cost of $110,000, plus 
approximately $15,000 in yearly support costs Z -§/ * r 
Thus> it is likely an operational system* of reasonable size 
wou\d Use its own computer rather , than -purchasing 
-^commercial services . • -V : J<. 

■ ; ■' ■•"•'.'*....•; ': ."".-...Viv +'•!'.••.•.''*' 'T:'.---!'.'; '.*•*.. ' •' '."'.•.'•.'••''>' : 

' •»•' r>',- : '":- v - : ; , ; ■ •' K- •••„- : - • ■ ': 

■ . A second issue that distinguishes the DCC demons tr a- ,, 

tion from an operational system is the existence of a ^ 
relatively large OT^ 

als, and modeAs in that network represent a v considerable v 
investment * The •integration of the TTY sys^m irito a : 
computer based system would be an essential compprient of 
any large scale network. The SRI demons tratioli is also 
focusing on /this problem. The existing. TTY network employs 
the 5-16vel Baudot character code which- is incompatible 
with the standard ,8-levei American Standard Code for Infor- 
mation Interchange (ASCII) . SRI is developing the necessary 
interface so that new, faster terminals, and TTYs will be 
able tb communicate • ' 

A third, and related issuers- the selection of term- 
inala. Currently , DCC is using so-called" "dumb 11 terminals/ 



^6/ All cost in f oirmat ion was proyided through personal 
communication with personnel at SRI International/ 
Telecommunications Sciences Center. These estimates 
were made only for preliminary planning purposes 
of SRI; and do not represent actual costs for an 

• . operating system. 



wrhich have no internal capability for storing and pro- 
cesising information ^ users must 

constantly on-line with the computer, increasing the 
potential for system conge s t}.on ; Data provided by t^e ^ 
DdC project show that in an average 12 -minute session , 
over one-half of the time is spent composing, editing 
and reading messages. The use of intelligent terminals 
would permit much of this activity to be conducted off- 
line, reducing operating costs and potentially increasing 
the number of users that could be accommodated by the 
computer. There ajje some intelligent terminals withoir| * 
hard copy printers available for the same cost ,($1> 100) 
as^ the dumb terminals currently being used . r 

All of this discussion is based on currently available 
techno lpgy , but all facets of computer technology are '/•. 
rapidly changing. Indeed, it has been predicted that cpsts 
of hardware and computer logic will decrease by a factor 
of ten every five years in the next decade, and that soft- ■ *V 
Ware and communications costs will decrease by a factor. of 
ten in the next decade. —£/ In addition, therefore, the cost 
reductions achieved by operating a larger network using 
current technology, technological advances can be expected 



— / Stefferud, E. , "Economics of Network Delivery of 
Computer Services'' , Compute r Networks , June. 1976, 
pp. 53-64. — ....4. 
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to yield an even greater reduction in costs. 

Potential for Economies of Scale : It vould aotie^r firom 
the <teta • p^ on " Cos ts i ahd piitput" 

and from the discussion of technological considerations 
that the potential for economies of scale is relatively 
high. As the system grows, in number of useray 
the cost of adding an additional user or sending an add! 
tional message .through the network will decline substan- 
tially. *A brief examination of. the major components of 
the system illustrates where those economies are likely 
to be achieved. -—/ ' 

A computer-assisted telecommunications network' for 
the deaf tan be thought of, overall, as consisting of 
five components: , • 

Terminals 4 

;"' j ■ • • . ' 

„ ■ • Communications / 

• Computer services 

• Software ' 

• Labor V 



8/ This discussion pertains only to cost reduc- 
tions achieved by increases in the scale of the 
network. It should not be confused with cost reduc- 
tions expected from technological advances mentioned 
earlier; these will occur independent of the network 



As with moat communications systems f a network' of this 
kind very * capital intensive . But the costs ' for ; thes^|:v; V;^ 
components are borne by different parties, so that in- 
creases in volume; of usage oti the network may not result ? 
directly infe '• 

For ex^mple V cb^^ ; borne -by:/-'-'' 

this Individual user is . Local telephone charges for dial-up 
acces s to at network port aria not af fected by system use and 
are detemined external arid ^ 

regulatory agencie s . . Cortoriijuiicatlons charges for access will, 
therefore , hot decline as ^ number of users increases. 
However , some economies dan be achieved in a network that 
includes long distance message forwarding • Messages being 
forwarded from one city to another can be accumulated and 
sent in batch and at a time that is most economical . SRI 
is using this approach in its demonstration to forward 
messages between Washington , D • C .and the San Francisco 
Bay Area, or Boston.' v 

Terminals for the DCC project were purchased in bulk 
and their costs were covered as part of the demonstration. 
In ah operational system, terminals would be purchased or 
leased one at a time by individuals. Although the potential 
market in the deaf community for modern terminals may be 
substantial, it is only a small share of the overall terminal 
market. Demand for terminals from the deaf community alone 



•• ; 'use<^ 
decline as ^: re 

network, particularly if more than one type of 

terminal is: used - 7-\;"r\:;;v •;•'•/ •■ '•; • 

There ^e; ecorK^ gained from the com^vter 

component. As discussed earlier , the network does not 
have to be very large to make the purchase of a dedicated * > 
mini-computer more economic than buying commercial computer 
services . The marginal 120s t of computer time # for any 
additional user ,is zero f cup to the poi^nt that the mini- 
computer is used- to capacity Beyond that , according to 
BBN , it is possible to- develop a larger system incrementally, 

where the cost of adding capacity to the system is quite 

'*■ .*.*"■ '*•*,/' "- • '■ •• ■ ■ ■ 

small and justifiable in terms of incremental use. * 

S . ■ ■ » _ - • - . • : v ■ • • . ■ . ■: . • . . ■ • .. v . • . 

The software component is generally a one-time expense 
for a system that is owned by an organization operating 
the network, its development costs are fixed so that the 
marginal cost of sending ^ach message beyond the first one 
is zero. Thus/ it is advantageous to increase usage as 
much as possible to cover the cost of the software component. 

The fifth system component is labor. This includes 
functions such as system administration, computer maintenance 
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fiuid Strain 

and maintenance will ftot grow in direct proportion to 
:.• Increases^ in tihe hfe of users r br the w 
so tiiat some scale economies in labor will result . The 
training/ function is relatively, labor intensive, although 
some economies are achievable through the development of 
large group training techniques. DCC will experiment this 
year with the use of a large screen video beam for instruc- 
tion of deaf users Thus,- there are some cost advantages 
here /also for increasing the size of the network. 

/ It appears that there are scale e conoirjies to be . 
realized in developing a large system. Marginal. coasts 
decline for the computer software and labor components of 



the system. The communications and terminal components 
offer little, if any, cost improvements by ^increasing the 
/number of users. However, the magnitude of the economies 
is uncertain, largely' because of the influence of . terminal 

costs. For example, if one assumes' that ther dedicated / 

v ■ ^ •-■ ; ,' ■•. - ; •-•'■t-.' ;• :• . •■ = . 7 . •■ / 

computer component costs approximately $110^000 (as SRI did 

in planning its demonstration) , and the cost of a modem 

terminal is $1 ,100 .(as it was for DCC) , then for a system 

of 1,000 users in a metropolitan area, the terminal costs 

dominate the system costs. 
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1.4 Western AX^^^ /•'. 
Werners vi I le State Hospital Interactive~Cable , 



Pennsylvania State University Continuing Education 
Cable Teievisioft^etwork ^ , ; r 



.Three other demonstration projects provided /cost data 
for their f ir st 18 mont^is p operation . These included 



/• ■ 



the Western Alabama Emergfency Medical Service (i^iS) , the 
Wernersviile State Hospital Interactive Cable intercon- 



nection and the Pennsylvania State University Continuing 
Education Cable Television Network ( PENN ARAMA ) • ' The s e 
projects made less progress in their first/ year than 



TALINET, CenTeX or the Deaf Community Cen^fer,/ and none 
progressed to the demonstration phase . Thus # r t he cos t data 
provided was not sufficient to conduct detailed cost 
analyses. However, there are several issues relating to 
thte design of demonstration projects that have surfaced 
from reviewing the available infoonatipn on the projects. 
Specifically, the three projects are : associated and 
integrated with other systems, institutions and funding 



. / 



sources to a greater degree than TALINET J CenTeX and the 
DCC. These organizational arrangements make the task of 
isolating and evaluating the costs attributable to the 
dembnstration very difficult .before turning to design 
issues , a brief description of each project and its 
reported costs for the first 18 months of operation is ' 
appropriate. 
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Western M Medical Services 

. . . . : ,;/.\ ■ .(- :cMs^ : '-.y . ' -.i '.<': ; : ' ■ ; '.v...... , 

The Western Alabama EMS is an attempt to establish 
a regional radio/ telephone system In a seven county area 
to simultaneously transmit voice and biomedical data from 
remote emergency sites to local and regional medical 
staff. The system links emergency medical technicians 
in traumatic injury situations with local community 
hospitals and a regional hospital . The purpose of the 
project is to provide rural populations with medical 
expertise and services that are currently available in . 



. metropolitan areas . 




In the first 18 months of the ; project the system 
was installed and testing was begun in tile sever! county .-.~<v 
region. DHEW/OTP provided funds necessary to purchase * 
equipment for four counties . These costs , provided by the 
project director , are shown in the first column of Exhibit 14 . 
As shown in the table , the Wester^ Alabama EMS project appears 
primarily under equipment purchase during the first 18 
months. Equipment, including v radio/ telephone. switching ' 
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stations , vehicular repeaters and field consoles , was 
purchased for a co^t of $117 , 308 . This represents 93 
percent of the first costs. The only other major expense 
was labor ($8,140) f and expenditures for equipment 
installation . However, these costs reflect only about 
one-third of the total project costs. The project 
'director estimates' that costs have been apprpximately 
$350, 000 during that first time period. Additional 
funcls were provided by the Emergency Medical Services 
Office of DHEW and the Governor 1 s Office for training 
of paramedics and the purchase of equipment for three 
other counties Tin the region* Participating hospitals 
have also contributed by making improvements in their 

communications facilities, although the project director 

» . . ' 9/ 

was not aware of the cost of these improvements. — ■ 

Data on total costs for the regional system were not 

available at the time of this cost analysis. 



9/ \ . 

These costs are not included in the $350,.000 
estimate mentioned above. 



Equipment, 

Communications and 
Computer Services 

Space 

Labor/ 

Programming/ / 
Software 

Miscellaneous 



Western Alabama v PENNARAMA 

* EMS \y V, I, 

l/15/7i * , 1/15/7.8 

6/15/7? 6/30/79 

$117>308 * $ 4 ,700 

340 500 

. 0 - 0 

8,190 ,<. 55,118 

. . 0 
. 7,000 




Wernersville 
State Hospital 

1/15/78 
6/25/79 

$67,274 



4,7U 
35,135 



1,560. 



TOTAL 



125,838* 



67,318 



108,680 



' *$27 f 000 of this total was incurred during the trial operation phase for 
'service on communications. 



PENNARAMA 

The PENNARAMA demonstration fociisas oh expanding tha 
educational oabla television aervioe provided by the Uni- 
versity to the Scrariton/Wilkea-Barre area to a statewide 
service by interconnecting existing other local cable 
systems. The original proposal was to provide intercon- 
nection using Instructional Television Fixed Service trans- 
mitters, but technical and legal complications prohibited 
that approach from being implemented. Instead, efforts 

Save been made to provide interconnection using CARS , a 
icrowave service assigned to the cable industry. In < order 
or a^jy networking to be complete^, local cable operators 
must reach agreement on financial and organizational 

immitmeats. In the project's first year operators have 
been unable to reach an agreement so that* interconnection 
has not yet been achieved. Other proj/ect objectives are 
tor aggregate program supply through collaborative arrange- 
ments with other providers and to promojte utilization of 

services. Because PENNARAMA has been unable to expand 

% ■ 

its audience beyond the existing. local audience, there 
has been little progress in accomplishing these objectives 
as well. " 

As shown in Exhibit 14, costs for the first 18 months 
of the PENNARAMA expansion project were predominantly 
labor costs for efforts in organizing the ^statewide net- 
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work and obtaining programming from o.ther providers. 
Total projact costs wars $67,318 of which $55,118, or 82 
percent, vara for labor. Once'again thasa costs, raflact 
only efforts to axpand the pennarama servicea. Costs 
associated with the broadcast services that wars baing 
provided before the DHEW demonstration began are not 
included. (PENNARAMA began providing local educational ^ 
programming two years before the DHEW demonstration began.) 

In the view of PENNARAMA project staff,. all of the 
project costs should be considered <as occurring during 
the demonstration phase since their project -was -to demon- * 
strate that an organization could be buiit that would 
expand the use of an already operational system. In any 
case PENNARAMA costs are attributable to only one project 
phase since the networking has not been accomplished at 
the time of Kalba Bowen's investigations. 

Wernersville State Hospital Interactive Cable 

. The Wernersville State Hospital Interactive Cable 
project is an attempt to link a state mental hospital 
with an- existing interactive- cable system operating in 
Berks County, Pennsylvania. The cable-microwave link to 
be established will allow hospital patients, many of whom 
are elderly' citizens, to participate in interactive social 
service programming produced by the New York University- 
Reading Consortium. At the end of the project's first 

* B67 14 ( J 
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18, months the interconnection had not baan completed. 

' . ' . • ■ . 

Coata incurred by the Werneraville State Hospital 
project are alto ahpwn in Exhibit 14. mite fiiret la months 
tha coata of equipment were 62 percent of total project . 
coata. Labor waa the only other major expense and repre- 
sented 32 percent of project coata. Space costs included 
these for modification of the studio, it is important to 
note that coats shown for the Wernersville project in the ... 
table reflect both federal and state expenditures. Of the 
$108,680 spent, $61,880 were funds provided by the DHEW 
demonstration program. Coats for all labor"; space and 
$6,954 of the equipment costs were borne by the state. 

Design issues 4 . / 

As discussed in Section' 2 , clarity in project 
design is essential for the/identification of 
true cost and the output for a telecommunications demon- 
stration . Meaningful economic analysis can best be con- 
ducted for demonstrations in which costs and output can 
be isolated. These th^ ee- projects do not exhibit this 

characteristic. The principal factors that will make it 

* / 

difficult to conduct' .a meaningful cost analysis include 
the following: ' 

• the project is integrated in an existing system in 
such a way that costs associated with the demon- 
stration pannot be clearly identified; 
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« the .project is integrated in an existing system 
in i such .a way that output attributable only to 
the demonstration can be clearly Identified. 

• multiple participants in the demonstration make 
* assembling complete cost information extremely 

..*•'" difficult. . 1 

Each of the three projects exhibits at least one of 
the above characteristics. FOr example, the educational 
television networking demonstration is integrated with the 
existing PENNARAMA broadcasting, service/ but the broadcast 
^services are not included in the direct costs of the 
project. Once a network is established/ how can the 
co.sts and output of the rietwork be separately examined . if 
the output (programming) originates from outside the 
demonstration? Costs associated with broadcasting the 
programming including fixed _and variable costs will have 
to be determined indirectly through some prorating 
procedure. These will be major costs of operating the 
network. V 

. ; Similarly, the Wernersville State Hospital project 
is dependent on the existence of outside, interactive 
programming. While the cost of operating the equipment 
at the hospital can be easily determined, the costs of 
creating art interactive system are shared with Berks County 
TV, with which the hospital will interconnect. • What portion 
of those costs, then, are attributable to the Wernersville 



•A 



demonstration? there is no donceptual framework for 
♦resolving this question. Just as perplexing is the 

difficulty in determining the output of system that is 

■ . ; " .kv- ' .-'V,: • ; y'- , ' f-:'-- 

attribu^l^le only to the, Werner svi lie demonstration where the 

In an interactive system the costs of 
one component of tAe system ; ' 

separately from the who le . The costs are inherently tied 
to the whole system and the analyst will have to resort to 
a somewhat arbitrary prorating procedure. 

The task of analyzing* the true costs of the Western 
Alabama EMS is also very difficult but the reason lies in 
the organizational arrangements for conducting the project. 
Direct funding for the project is bein£ provided through 
several sources. The Office of Telecommunications and • « 
Office of Emergency . Medical Services in* DHEW provided funds 
for equipment purchases . The Governor's Off iqe is pro- 
viding funds for training and local hospitals are absorbing 
a portion of the operating costs. This can - lead to con- 
fusion over the interests of the various funding agencies . 
For example, data submitted for this cost analysis by the 
project director included only funds provided by DHEW/OTP . 
When contacted about this, the project director was unaware 
that in this analysis we are interested in the entire , 
demonstration. 
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Responsibility for the project is also fragmented. 

• ' ■ ■ ■ . . ■ ■• - 

Funds were- obtained by the Telecommunications Division of 

the Alabama Development Office, but the ' project is being 
run by medical personnel from other agencies and institu- 
tions. Thus, the responsibility for tracking costs lies 
with one agency while project performance lies with v 
another group. From discussions with the project director, 
it is unclear how costs and output are to be analyzed in 
the evaluation the project staff intends to conduct. 
Given the relatively small portion of funds DHEW/OTP is 
contributing to the project, and the fact that respon- 
sibility for the project is fragmented, the question of 
whether DHEW/QTP will have sufficient control pver the 
project to conduct a cost analysis arises. J» 

In short, all three projects are designed such that 
they have substantial additional costs. In the PENNARAMA 
and Wernersville State Hospital projects these costs are 
hidden in the systems in which the projects are inte- 
grated. In the Western Alabaiaa Emergency Medical Service 
project additional costs are borne by federal, state and 
local funding institutions and represent a large majority 
of tota^L project costs. . In many instances the determination 



of these additional costs will be judgmental. In others 
there is the practical difficulty of sorting out costs 
and output from 'the many participants . These problems \ : . 
of analyzing the performance of the demonstrations 
greatly reduce the usefulness of any cost analyses that 
may be conducted. From an analysis of these three 
projects , it can be concluded that telecommunications 
demonstrations should be designed , where possible , t as 
stand-alone systems so that cost and outputs are easily 
identifiable. Where this is not possible , projects 
should be designed from the start in such manner that 
the demonstration can still be conducted as a controlled 
experiment;. 0 True costs and outputs attributable only to 
the demonstration should be clearly identifiable. 
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